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About  Our  New  Look  . . . 


This  qao  report  was  produced  using  a  new  design  and  printing  process 
to  help  you  get  the  information  you  need  more  easily. 


gao  will  phase  in  this  new  design  during  1986.  As  we  do  so,  we  welcome 
any  comments  you  wish  to  share  with  us. 


GAO 


United  States 

General  Accounting  Office 

Washington,  D.C.  20548 


Comptroller  General  of  the  United 

States 

B-220298 


November  4,  1985 

To  the  President  of  the  Senate  and  the 
Speaker  of  the  House  of  Representatives 

recently  reviewed  the  Navy’s  three-phased  Submarine  Advanced 
Combat  System  (subacs)  program,  subacs  was  designed  to  provide  Los 
Angeles  class  nuclear  attack  submarines  (SSN  688  class)  authorized  for 
fiscal  year  1983  and  beyond  with  new  and  upgraded  sonar  and  combat 
control  systems  and  advanced  data  processing  capabilities.  A  modifica¬ 
tion  of  subacs  was  also  planned  as  the  combat  system  design  for  the 
proposed  new  attack  submarine  class,  SSN  21,  scheduled  for  authoriza¬ 
tion  in  fiscal  year  1989.  We  performed  this  review  to  determine  the  cost, 
schedule,  and  performance  risks  associated  with  implementing  the 
subacs  program  and  its  impact  on  attack  submarine  programs.  ^Scc  app^ 

4tfe  found  that  since  the  Secretary  of  Defense  approved  the  program  in 
October  1983,  SUBACS  has  experienced  significant  cost,  schedule,  and 
performance  problems.  To  address  these  problems,  the  Navy  has  made 
several  programmatic  decisions,  resulting  in  a  restructure  of  the  pro¬ 
gram.  As  a  result,  the  program  is  no  longer  being  implemented  as 
approved.  Because  of  the  risks  and  uncertainties  identified  with  imple¬ 
menting  the  latest  program  plan,  we  believe: that  the  restructured  pro¬ 
gram  needs  to  be  evaluated  and  implemented  only  with  the  approval  of 
the  Secretary  of  Defense. 

On  October  25,  1985,  the  Department  of  Defense  provided  comments  on 
a  draft  of  this  report  which  have  been  incorporated  in  this  final  report. 


The  Defense- Approved 
SUBACS  Program 


‘Pre-Planned  Product  Improvement  is  an  acquisition  strategy  that  incorporates  advanced  technology 
through  planned  upgrades.  It  is  adopted  early  in  a  system’s  development  and  is  used  to  ( 1 )  reduce 
acquisition  time  and  development  risk  and  cost  and  (2)  enhance  fielded  performance. 


The  Navy  initiated  subacs  in  1980  to  meet  expanded  SSN  688  class  mis¬ 
sions  and  to  counter  the  Soviet  antisubmarine  warfare  threat  through 
the  1990s.  subacs  was  originally  planned  as  a  single-phase  program  for 
SSN  688  class  submarines  authorized  in  fiscal  year  1989.  However,  in 
October  1983,  the  Secretary  of  Defense  approved  the  Navy’s  plan  to 
introduce  subacs  as  a  Pre-Planned  Product  Improvement1  program  in 
three  phases.  (See  app.  II.) 
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The  three  phases  were  subacs  Basic,  sijbacs  A,  and  subacs  B.  The  objec¬ 
tives  of  the  three-phased  approach  were  to  allow  the  Navy  to  introduce 
additional  capabilities  earlier  than  planned  and  to  spread  program  risks 
and  costs  over  time.  More  significantly,  the  approved  program  intro¬ 
duced  subacs  on  the  SSN  751,  an  SSN  688  class  submarine  authorized  in 
fiscal  year  1983  and  already  under  construction,  rather  than  on  a  sub¬ 
marine  scheduled  for  authorization  in  fiscal  year  1989. 

subacs  Basic,  the  first  phase,  was  to  upgrade  existing  sonars,  add  new 
sonar  subsystems,  and  provide  for  processing  of  acoustic  information  by 
a  distributed  system  data  bus.2  It  was  scheduled  to  be  installed  on  the 
SSN  688  class  submarines  authorized  in  fiscal  years  1983,  1984,  and 
1985.  The  nine  suBACS-equipped  submarines  authorized  in  those  fiscal 
years  are  currently  under  construction  by  two  shipbuilders.  Five  are 
under  construction  at  the  Electric  Boat  Division  of  General  Dynamics 
Corporation  and  four  are  under  construction  at  Newport  News  Ship¬ 
building  Company. 

subacs  A,  the  second  phase,  was  to  integrate  acoustic  and  combat  con¬ 
trol  processing  by  using  new  and  upgraded  software,  subacs  A  was  for 
SSN  688  class  submarines  scheduled  to  be  authorized  in  fiscal  years 
1986  through  1988. 

subacs  B,  the  third  phase,  was  to  introduce  sonar  improvements  into  the 
integrated  combat  system.  This  phase  was  for  SSN  688  class  submarines 
scheduled  to  be  authorized  in  fiscal  year  1989  and  beyond.  A  modifica¬ 
tion  of  subacs  was  also  the  combat  system  design  for  the  proposed  new 
attack  submarine  class,  SSN  21. 

In  December  1983,  the  Navy  awarded  the  International  Business 
Machines  Corporation  (IBM)  a  $772  million  contract  for  concurrent  full- 
scale  development  and  production  of  five  subacs  Basic  systems  and  for 
an  engineering  development  model.3  The  first  subacs  Basic  system  must 
be  delivered  to  the  shipbuilder  by  May  1987  to  meet  the  November  1987 
delivery  of  the  first  suBACS-equipped  submarine  to  the  Navy. 


2The  distributed  system  data  bus  (described  in  app.  Ill  and,  hereafter,  referred  to  as  data  bus)  uses 
fiber  optic  technology  to  distribute  and  communicate  data  and  to  link  acoustic  and  combat  control 
subsystems  into  one  major  combat  system. 

3An  engineering  development  model  is  used  in  the  factory  to  support  the  completion  of  hardware  and 
software  development  prior  to  the  availability  of  a  production  system. 


Page  2 


GAO/NSIAIV86-12  SUBACS  Problems 


B-220298 


Problems  Affecting 

Program 

Implementation 


subacs  has  experienced  significant  cost,  schedule,  and  technical  per¬ 
formance  problems  that  have  adversely  affected  program  implementa¬ 
tion.  We  believe  several  factors  have  contributed  to  subacs  problems. 
These  included  Navy  decisions  to  (1)  introduce  innovative  technology 
into  new  construction  attack  submarines  through  a  concurrent  develop¬ 
ment  and  production  program,  (2)  install  the  initial  subacs  on  a  fiscal 
year  1983  submarine  rather  than  on  one  scheduled  for  authorization  in 
fiscal  year  1989,  as  originally  planned,  and  (3)  approve  the  shipbuilder’s 
accelerated  delivery  schedules  for  initial  suBACS-equipped  submarines. 
As  a  result  of  these  decisions,  program  success  became  highly  dependent 
upon  receiving  sufficient  funding,  maintaining  tight  cost  control,  and 
meeting  crucial  schedule  dates  in  each  of  the  phases.  In  addition,  accord¬ 
ing  to  a  high-level  Navy  committee,  some  management  weaknesses  fur¬ 
ther  contributed  to  the  cost,  schedule,  and  performance  risks  in  the 
subacs  program. 


Cost  control  has  been  a  continuing  problem  in  the  subacs  program.  As  a 
result,  SUBACS  has  experienced  significant  cost  increases  in  the  estimates 
to  complete  the  program. 

In  1983,  the  Navy  estimated  total  subacs  acquisition  costs  to  be  $3.8 
billion.  Life-cycle  costs4  were  estimated  at  $14.5  billion  in  fiscal  year 
1983  dollars  and  over  $29  billion  in  escalated  dollars. 

As  early  as  April  1983,  a  Naval  Material  Command  audit  indicated  the 
subacs  Basic  phase  would  cost  $762  million,  $105  million  more  than  the 
Navy’s  initial  estimate.  When  the  subacs  Basic  contract  was  negotiated 
with  IBM  in  December  1983,  however,  the  cost  of  the  phase  increased  by 
$10  million  over  the  audit’s  estimate.  Moreover,  ibm  estimated  a  $3.8 
million  contract  increase  in  its  first  subacs  Basic  Cost  Performance 
Report  in  March  1984.  To  absorb  these  increased  costs,  the  Navy,  in 
June  1984,  decided  to  delay  several  portions  of  the  overall  subacs  devel¬ 
opment  program. 

An  additional  cost  problem  was  identified  in  November  1984,  when  the 
Navy,  based  on  the  results  of  an  internal  audit  by  the  Program  Office 
for  subacs,  determined  the  total  subacs  program  in  the  fiscal  year  1985 
Five  Year  Defense  Program  would  require  $853  million  more  in 


4 Life-cycle  cost  is  the  total  cost  to  the  government  of  acquisition  and  ownership  of  a  system  over  a 
defined  life  span.  It  includes  the  cost  of  development,  investment  (production  and  construction),  and 
operation  and  support. 


Page  3 


GAO/NSIAD-86-12  SlIBACS  Problems 


B-220298 


Research,  Development,  Test  and  Evaluation  funding.  According  to  the 
Program  Office,  the  increase  was  due  to  new  and  unfunded  require¬ 
ments,  program  stretch-outs  resulting  from  budget  cuts,  future  funding 
needs,  and  cost  overruns  in  the  subacs  Basic  contract.  To  address  this 
cost  problem,  the  Navy  restructured  the  subacs  development  program  in 
[■- :  an  effort  to  contain  potential  cost  increases. 

In  regard  to  the  subacs  Basic  contract,  ibm,  in  its  June  1985  Cost  Per¬ 
formance  Report,  estimated  a  $  146.2  million  overrun  in  its  contract  to 
complete  subacs  Basic  full-scale  development.  While  about  $68.2  million 
of  this  increase  was  identified  in  the  1984  internal  audit,  $78  million 
was  not.  This  overrun  was  primarily  due  to  increased  software  and  sys¬ 
tem  development,  additional  test  and  integration  requirements,  and  sub¬ 
contractor  and  vendor  production  problems. 

In  commenting  on  the  draft  report,  Defense  said  that  the  Navy  was 
aware  of  the  cost  overrun  before  the  June  1985  Cost  Performance 
Report  was  issued  and  that  the  estimate  formed  part  of  the  basis  for  the 
Navy  initiating  contract  scope  reduction  efforts.  Additionally,  since  our 
review  was  completed,  Defense  said  the  Secretary  of  the  Navy  has 
approved  the  contract  scope  reductions. 

As  of  May  1985,  the  Navy  estimated  life-cycle  costs  to  be  $15  billion  in 
1983  dollars,  about  $500  million  more  than  originally  estimated.  The 
Navy  does  not  have  an  official  revised  estimate  of  the  program’s  acqui¬ 
sition  costs. 


Schedule  We  believe  the  selection  of  the  SSN  751  (authorized  in  fiscal  year  1983 

and  scheduled  for  delivery  in  November  1987)  as  the  first  subacs- 
equipped  SSN  688  class  submarine  rather  than  one  scheduled  for 
authorization  6  years  later  (fiscal  year  1989)  made  it  difficult  to  achieve 
program  schedules.  For  example,  as  early  as  June  1983,  a  Naval  Under¬ 
water  Systems  Center  (nusc)6  risk  assessment  predicted  that  the  devel¬ 
opment  of  the  distributed  system  data  bus  was  a  high  risk  and  would  be 
completed  9  to  12  months  later  than  scheduled  to  meet  the  delivery  of 
the  SSN  751.  The  schedules  provided  little  flexibility  to  deal  with  prob¬ 
lems  normally  encountered  when  introducing  new  and  unproven  tech¬ 
nology  through  a  concurrent  development  and  production  program. 


6NUSC  is  the  lead  laboratory  and  the  Navy's  Technical  Direction  Agent  for  the  SUBACS  program.  It 
provides  technical  guidance  to  SUBACS  contractors  and  assists  the  Navy’s  Project  Office  in  technical 
and  design  reviews. 
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In  commenting  on  our  draft  report,  Defense  officials  stated  that  assess¬ 
ments  other  than  those  prepared  by  nusc  were  considered.  Defense 
stated  that  while  none  of  these  assessments  claimed  the  development 
was  risk-free,  the  aggregate  showed  the  risk  was  acceptable,  particu¬ 
larly  when  additional  modeling  and  testing  was  incorporated  into  the 
program.  While  we  recognize  other  assessments  were  considered,  we 
emphasized  the  nusc  assessment  because  nusc,  as  the  Navy’s  Technical 
Direction  Agent  for  the  subacs  program,  is  responsible  for  evaluating 
development  risks  and  providing  overall  technical  advice. 

A  February  1985  nusc  technical  risk  assessment  identified  eight  major 
hardware  subsystems,  such  as  the  weapons  launch  system,  as  medium 
to  high  risk  for  delayed  deliveries  to  the  shipbuilder.  The  potential 
delays  were  related  to  ceramic  and  other  module  design,  development, 
and  production  problems  due  to  vendor  difficulties  in  meeting  Navy 
testing  requirements  and  low  production  yields.  According  to  the  assess¬ 
ment,  software  development  was  also  a  high  schedule  risk.  In  addition, 
in  February  1P85,  IBM  estimated  that  six  software  deliveries  would  be 
delayed  from  2  months  to  more  than  2  years  because  of  insufficient  time 
to  test,  integrate,  and  modify  system  software. 

In  commenting  on  our  draft  report,  Defense  also  stated  that  the  Febru¬ 
ary  1985  NUSC  hardware  risk  assessment,  commissioned  by  the  Project 
Office,  was  used  to  restructure  the  program.  Defense  noted  that  prob¬ 
lems  with  ceramic  modules  have  been  solved  and  that  sufficient  modules 
for  the  first  ship  set  are  on  hand.  However,  the  modules  were  delivered 
late  and  Defense  did  not  comment  on  the  impact  continued  delays  in 
module  deliveries  might  have  on  future  ships. 


In  our  opinion,  the  most  serious  problem  affecting  subacs  implementa¬ 
tion  relates  to  the  development  of  the  data  bus  and  the  software  neces¬ 
sary  to  process  and  distribute  acoustic  information.  Preliminary  critical 
item  tests  made  by  IBM  in  December  1984  showed  that  the  data  bus’  soft¬ 
ware  system  distributed  data  at  a  rate  about  one-sixth  of  the  original 
program  requirements.  According  to  nusc,  this  reduction  in  speed  would 
prevent  combat  system  operators  from  receiving,  interacting,  and 
responding  to  acoustic  information  fast  enough  to  solve  combat  prob¬ 
lems  on  a  real-time  basis  (i.e.,  as  they  occur).  In  addition,  nusc’s  Febru¬ 
ary  1985  assessment  stated  that  data  bus-related  problems  severely 
constrained  system  test  and  integration  schedules,  “leaving  virtually  no 
margin  for  error.” 
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For  more  information  on  subacs  cost,  schedule,  and  performance  prob¬ 
lems,  see  appendix  III. 


Other  Factors  Contributing  Two  additional  factors  contributed  to  the  cost,  schedule,  and  perform- 
to  Program  Problems  ance  problems.  First  is  the  Navy’s  decision  to  accelerate  ship  delivery 

schedules  for  the  first  two  suBACS-equipped  submarines.  The  accelerated 
schedules  allow  shipbuilders  to  claim  award  fees  for  increasing  produc¬ 
tivity  and  reducing  construction  schedules.  For  example,  Electric  Boat 
(the  shipbuilder)  is  planning  to  deliver  the  SSN  751  in  November  1987, 
about  8  months  earlier  than  the  contract  delivery  date  of  June  1988. 

The  earlier  delivery  of  the  SSN  751  would  reduce  the  time  available  to 
install  the  subacs  Basic  system  from  12  months  to  5  months.  Under  the 
terms  of  its  contract  with  Electric  Boat,  the  Navy  must  deliver  subacs 
Basic  equipment  for  the  SSN  751  to  Electric  Boat  no  later  than  May 
1987. 

The  second  factor  relates  to  the  Navy’s  management  of  the  program. 
During  April  and  May  1985,  a  committee  of  high-level  Navy  military 
and  civilian  personnel  reviewed  the  feasibility  of  the  data  bus  and  other 
alternative  systems  for  subacs.  Its  report  stated  that  the  Navy’s  man¬ 
agement  structure  provided  neither  the  necessary  focus  nor  the  effec¬ 
tive  use  of  program  management  control  procedures,  such  as  cost, 
schedule,  and  technical  reports.  Also,  the  report  indicated  that  nusc,  as 
the  lead  Navy  laboratory,  had  not  provided  a  strong  technical  input  to 
the  development  program.  The  committee  recommended  several  changes 
to  strengthen  program  management  and  concluded  that  the  subacs  pro¬ 
gram  would  not  be  under  control  until  these  weaknesses  are  resolved. 
(See  app.  IV.) 

In  commenting  on  our  draft  report,  Defense  stated  that  the  Naval  Sea 
Systems  Command  (navsea)  and  nusc  are  restructuring  their  respective 
organizations  for  the  subacs  program.  Both  navsea  and  nusc  are  defin¬ 
ing,  in  concert,  responsibilities,  lines  of  communications,  and  accounta¬ 
bility  to  ensure  proper  roles  are  established  and  performed.  Defense 
stated  that  this  effort  would  be  completed  and  in  place  by  November  1, 
1985. 
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Replanning  Efforts 


In  attempting  to  address  the  cost,  schedule,  and  performance  problems 
experienced  in  subacs  Basic,  the  Navy  and  IBM  revised  the  subacs  pro¬ 
gram  plan  several  times  between  October  1984  and  May  1985.  The  latest 
plan  adopted  by  the  Navy  calls  for  the  redesigned  subacs  Basic  system 
to  be  installed  on  the  SSN  688  class  submarines  authorized  in  fiscal 
years  1983  through  1988,  rather  than  on  just  those  authorized  in  fiscal 
years  1983  through  1985.  This  system  will  have  less  combat  system  per¬ 
formance  than  the  system  originally  planned.  Also,  we  believe  signifi¬ 
cant  program  risks  and  uncertainties  exist  with  implementing  the 
restructured  program  plan. 


The  first  replanning  effort,  Replan  I,  was  initiated  in  August  1984  and 
approved  in  October  1984.  It  addressed  subacs  Basic  ceramic  module 
design,  development,  and  production  problems  which  had  caused  hard¬ 
ware  delivery  delays  by  an  IBM  subcontractor  to  IBM’s  test  and  integra¬ 
tion  facilities. 

Replan  II  was  initiated  in  December  1984  in  response  to  continued  slips 
in  ceramic  module  production  and  supply.  In  addition,  in  January  1985, 
performance  and  escalating  cost  problems  with  the  data  bus  were 
addressed.  Major  actions  taken  by  the  Navy  under  this  replan  were  to 
remove  the  combat  control  subsystem  from  the  data  bus,  defer  some 
subacs  Basic  functions  from  May  1987  to  September  1988,  and  delay 
implementing  the  subacs  A  phase  from  fiscal  year  1986  to  fiscal  year 
1989. 

In  March  1985,  the  Secretary  of  the  Navy  instructed  that  funding 
requirements  for  Navy  acquisition  programs  remain  within  fiscal  year 
1985  Five  Year  Defense  Program  levels.  The  Navy  determined  that 
Replan  II  could  not  be  entirely  implemented  within  available  program 
funding  and  additional  replanning  actions  were  necessary. 

Replan  III,  initiated  in  March  1985,  had  the  most  significant  impact  on 
the  subacs  design.  It  deleted  the  data  bus  entirely  from  the  program  and 
proposed  replacing  the  data  bus  with  a  standard  computer-based 
processing  system.  This  system’s  software  will  be  designed  and  tested  at 
the  same  time  the  new  hardware  is  integrated  into  subacs. 

Because  of  the  problems  encountered  during  subacs  Basic,  the  subacs  A 
and  B  phases  have  been  deferred  until  1989  or  later.  Originally,  subacs 
A  was  to  be  installed  on  SSN  688  class  submarines  authorized  in  fiscal 
years  1986  through  1988,  and  subacs  B  was  to  be  installed  on  SSN  688s 
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authorized  in  1989  and  beyond.  However,  as  a  result  of  system  design 
changes  and  reduced  performance  under  Replan  III,  the  Replan  III  pro¬ 
posals  would  convert  the  three-phased  SUBACS  program  to  a  one-phase 
effort —  subacs  Basic  minus  the  data  bus — for  SSN  688  class  subma¬ 
rines  authorized  from  fiscal  years  1983  through  1988.  The  subacs  A  and 
B  phases  have  been  combined  in  the  new  FY  89  Combat  System  program 
for  attack  submarines  authorized  beginning  in  fiscal  year  1989,  includ¬ 
ing  the  SSN  21.  In  effect,  there  are  two  separate  programs — subacs 
(Replan  III)  and  the  FY  89  Combat  System.  Under  the  FY  89  Combat 
System  program,  new  sonars,  signal  processors,  and  software  will  be 
developed. 

In  commenting  on  the  draft  report,  Defense  maintained  that  subacs  is 
now  a  two-phased  program — Replan  III  as  phase  one  and  the  FY  89 
Combat  System  as  phase  two.  Defense  stated  that  the  FY  89  Combat 
System  is  an  evolutionary  improvement  to  Replan  III.  According  to 
Defense,  each  phase  will  be  managed  as  a  separate  project. 


Navy’s  Review  of  Replan  III  Because  Replan  III  was  a  major  design  change  to  subacs,  on  April  24, 

1985,  the  Assistant  Secretary  of  the  Navy  for  Research,  Engineering  and 
Systems  appointed  a  committee  to  review  the  program.  The  committee 
directed  its  review  primarily  toward  combat  system  alternatives  that 
would  address  the  immediate  cost  and  schedule  problems  and  that 
would  assure  confidence  in  delivering  the  SSN  751  on  time.  In  its  May 
28,  1985,  report  to  the  assistant  secretary,  the  committee  agreed  with 
the  Replan  III  proposal  to  delete  the  data  bus,  but  recommended  an 
alternative  combat  system,  the  “BQQ-56  Like,”  which  would  use  some 
portions  of  systems  currently  installed  on  SSN  688  class  submarines. 

The  committee  believed  that  Replan  III  was  overly  optimistic,  had  a  low 
chance  of  meeting  delivery  schedules,  and  had  unpredictable  cost  and 
schedule  risks. 

On  May  31,  1985,  the  assistant  secretary  requested  more  detailed  infor¬ 
mation  on  the  cost  and  schedule  impacts  of  the  two  alternatives — 
Replan  III  and  "BQQ-5  Like.”  navsea  established  a  second  committee  to 
develop  this  information.  In  its  July  1,  1985,  report,  the  second  commit¬ 
tee  concluded  that  neither  alternative  would  meet  the  original  subacs 
performance  requirements,  even  though  the  Navy  had  made  several 
changes  to  Replan  III.  Changes  included  freezing  the  design  of  critical 
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equipment,  delaying  tests,  and  adding  an  essential  capability  earlier 
than  planned.  The  committee  also  concluded  that  the  cost  increase  of 
implementing  the  “BQQ-5  Like”  alternative  was  six  times  greater  than 
the  cost  increase  under  Replan  III.  In  addition,  the  “BQQ-5  Like”  system 
would  have  a  greater  adverse  impact  on  ship  delivery  schedules.  On 
August  9,  1985,  the  assistant  secretary  approved  Replan  III.  (See  app. 
IV.) 

In  commenting  on  our  draft  report,  Defense  stated  that  the  “BQQ-5 
Like”  system  is  essentially  the  same  system  being  developed  under 
subacs  Replan  III,  with  certain  high-risk  hardware  replaced  with 
proven,  less-capable  components  from  the  AN/BQQ-5  sonar  system. 
Defense  also  stated  that  the  remaining  hardware,  developed  under  the 
subacs  program,  is  still  required  because  the  system  currently  installed 
on  SSN  688  class  submarines  is  too  large  to  fit  in  the  space  allocated  for 
the  combat  system  in  the  fiscal  years  1983  through  1988  SSN  688  class 
submarines. 


Although  the  Navy  chose  Replan  III  as  the  preferred  alternative  for 
addressing  SUBACS  Basic  problems,  we  believe  that  significant  risks  and 
uncertainties  still  exist  that  could  adversely  affect  program  implementa¬ 
tion.  At  the  time  of  the  proposal  and  the  Navy’s  evaluation  of  Replan  III, 
key  documentation  was  not  complete.  According  to  the  subacs  Project 
Manager,  detailed  program  plans,  work  breakdown  structures,  critical 
path  analyses,  and  work  packages  for  Replan  III  were  scheduled  to  be 
completed  in  October  1985.  Further,  contract  modifications  required  to 
implement  Replan  III  must  then  be  negotiated  and  approved. 

In  addition,  the  second  committee  identified  major  technical  risks  and 
uncertainties  with  implementing  Replan  III.  These  included  problems 
with  developing,  integrating,  and  producing  system  software,  particu¬ 
larly  for  one  critical  hardware  item,  a  common  beamformer.  According 
to  the  committee,  these  problems  could  cause  the  software  for  the  first 
two  systems  to  be  immature  (not  fully  tested,  integrated,  and  modified) 
when  delivered  to  the  shipbuilder.  Consequently,  this  could  result  in  late 
delivery  of  the  first  two  suBACS-equipped  submarines  and  may  subject 
the  Navy  to  costly  shipbuilder  claims  associated  with  the  delays. 

Moreover,  the  second  committee  stated  that  these  submarines  at  deliv¬ 
ery  will  have  a  combat  system  with  less  performance  than  required 
under  Replan  III.  For  instance,  software  for  the  SSN  751  combat  system 
will  be  upgraded  twice — once,  2-3  months  after  submarine  delivery  and 
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again,  9  months  after  submarine  delivery.  With  respect  to  the  later 
upgrade,  the  committee  also  reported  that  test  and  integration  planning 
for  the  system’s  software  was  incomplete  and,  therefore,  prevented  a 
meaningful  assessment  of  schedule  risk. 


subacs  was  initiated  to  provide  a  combat  system  capable  of  carrying  out 
the  expanded  missions  of  U.S.  attack  submarines  and  to  counter  an 
improving  Soviet  submarine  threat.  Serious  development  problems, 
however,  have  resulted  in  the  Navy  revamping  the  program  strategy.  As 
a  result,  the  program  is  no  longer  being  implemented  as  presented  to  the 
Defense  Systems  Acquisition  Review  Council  (dsarc)  and  approved  by 
the  Secretary  of  Defense  in  1983.  The  revised  strategy  should  be  evalu¬ 
ated  by  the  Secretary  of  Defense  and  implemented  only  with  his 
approval. 

Under  the  latest  Navy  plan,  Replan  III,  subacs  will  provide  less  perform¬ 
ance  than  originally  intended,  require  additional  funds,  and  may  delay 
the  delivery  of  the  first  two  suBACS-equipped  SSN  688  submarines.  Fur¬ 
ther,  should  Replan  III  be  unsuccessful,  SSN  688  class  submarines  sched¬ 
uled  for  authorization  in  fiscal  years  1986  through  1992,  as  well  as  the 
nine  currently  under  construction,  could  incur  increased  costs  and 
potential  delivery  delays. 

A  dsarc  is  scheduled  to  review  the  subacs  program  in  November  1985. 
Because  of  the  potential  impacts  on  the  SSN  688  class  submarine  pro¬ 
gram  and  the  risks  and  uncertainties  identified  with  Replan  III,  we 
strongly  support  the  scheduled  dsarc  review.  We  believe  this  review  is 
needed  to  assure  that  all  alternatives,  near  and  long  term,  are  fully  con¬ 
sidered  to  minimize  subacs  cost,  schedule,  and  technical  performance 
problems  and  to  lessen  the  potential  adverse  impacts  on  the  Navy’s 
attack  submarine  programs.  We  also  believe  that  because  the  reviews  by 
the  Navy’s  committees  primarily  focused  on  near-term  solutions  to  the 
problem  of  providing  a  combat  system  for  the  first  nine  suBACS-equipped 
submarines,  all  viable  long-term  alternative  acquisition  strategies  were 
not  fully  considered  for  the  remaining  attack  submarines  that  will  have 
subacs.  These  strategies  could  possibly  include  delaying  the  deliveries  of 
the  SSNs  751  and  752,  terminating  the  subacs  program  and  returning  to 
the  current  BQQ-5  system  for  SSN  688  submarines  authorized  beginning 
in  fiscal  year  1985,  or  developing  a  new  distributed  system  data  bus.  In 
regard  to  the  SSN  21  class  attack  submarine  program,  we  believe  that 
the  lessons  learned  from  subacs  problems  should  be  applied  in  develop¬ 
ing  the  new  combat  system  for  the  SSN  21. 


Page  10 


GAO/NSIAD-86-12  SUBACS  Problems 


B-220298 


Recommendations  to 
the  Secretary  of 
Defense 


Since  the  subacs  program  is  no  longer  being  implemented  as  approved 
by  the  Secretary  of  Defense  and  because  of  the  risks  and  uncertainties 
identified  with  implementing  Replan  III  and  its  potential  impact  on  the 
Navy’s  attack  submarine  programs,  we  recommend  that  the  Secretary  of 
Defense  take  the  following  actions  through  the  dsarc  program  review 
process: 

Evaluate  the  Navy’s  justification  for  adopting  Replan  III  from  among 
alternative  acquisition  strategies  to  ensure  the  best  course  of  action  is 
taken  for  providing  SSN  688  class  submarines,  near  and  long  term,  with 
the  needed  combat  system  performance  while  minimizing  the  adverse 
effects  on  subacs  and  submarine  construction  costs,  schedules,  and 
contracts. 

Condition  his  approval  of  the  program  on  the  Navy’s  establishment  of  a 
plan  for  management  control,  including  specific  criteria,  reporting 
requirements,  and  periodic  reviews  of  the  program  adopted  to  assess  the 
progress  in  reaching  subacs  program  objectives. 

Before  releasing  fiscal  year  1986  program  funds,  require  the  Navy  to 
provide  key  program  documentation  and  budget  quality  cost  estimates, 
and  base  the  future  release  of  funds  on  demonstrated  program  progress. 


Agency  Comments  and 
Our  Evaluation 


Defense  provided  comments  on  a  draft  of  this  report  on  October  25, 
1985.  (See  app.  V.)  Defense  concurred  with  our  findings,  subject  to 
minor  clarifications. 


Defense  essentially  agreed  with  our  conclusions.  The  one  exception  was 
its  disagreement  that  all  available  alternative  acquisition  strategies, 
such  as  delaying  the  SSNs  751  and  752,  terminating  the  subacs  program 
and  returning  to  the  current  BQQ-5  system,  or  developing  a  new  distrib¬ 
uted  system  data  bus,  were  not  fully  considered  during  reviews  by  the 
two  Navy  subacs  committees.  Defense  stated  that  these  alternatives 
were  considered  but  were  not  seriously  considered  or  mentioned  in  the 
committees’  reports  because  the  prohibitive  cost  and  serious  operational 
impact  of  the  alternatives  were  unacceptable.  It  stated  that  in  retrospect 
the  alternatives  should  have  been  included  in  the  committees’  reports. 
We  believe  the  committees’  focus  on  a  near-term  solution  is  a  step  in  the 
right  direction  for  addressing  the  problem.  When  considered  in  the  long 
term  for  all  submarines  to  be  equipped  with  subacs,  the  alternative 
strategies  we  identified  or  others  may  be  viable  options  for  ensuring 
that  the  best  course  of  action  is  taken  for  providing  the  needed  subma¬ 
rine  combat  system  performance. 
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Defense  agreed  with  our  first  two  recommendations,  but  was  concerned 
that  our  third  recommendation  was  calling  for  withholding  release  of 
fiscal  year  1986  funds  before  the  November  1985  dsarc.  It  said  that 
such  an  action  would  result  in  stop  work  orders,  costly  termination  and 
restart  proceedings,  and  would  guarantee  further  costly  delays  in  the 
program.  The  thrust  of  our  recommendation  is  to  withhold  funds 
subsequent  to  dsarc  if  the  Navy  does  not  provide  budget  quality  esti¬ 
mates  and  key  documentation,  including  a  sound  plan  for  management 
control  that  accounts  for  the  risks  and  uncertainties  facing  development 
and  production  of  the  system.  Defense  said  that  the  Navy  would  be 
required  at  the  dsarc  to  provide  such  cost  estimates  and  documentation. 

We  also  want  to  reemphasize  that  in  the  November  1985  dsarc  process 
the  Office  of  the  Secretary  of  Defense  should  review  and  evaluate  the 
Navy’s  key  program  documentation  and  the  budget  estimates  and  that  a 
Secretary  of  Defense  Decision  Memorandum  be  issued. 


Copies  of  our  draft  report  were  provided  to  the  three  major  subacs  con¬ 
tractors — ibm  Corporation,  Hughes  Aircraft  Company,  and  Raytheon 
Company.  Hughes  and  Raytheon  did  not  provide  any  comments,  ibm  pro¬ 
vided  comments  and  stated  that  the  report  was  generally  factually  accu¬ 
rate  for  the  time  period  it  covered.  It  expressed  the  view,  however,  that 
many  of  the  issues  highlighted  as  problems  are  no  longer  applicable  as 
risk  factors  to  the  program.  While  IBM  believes  its  current  program  plan 
supports  submarine  delivery  schedules,  the  detailed  plans  for  imple¬ 
menting  Replan  III  need  to  be  reviewed  and  approved  by  the  Navy.  IBM’s 
complete  comments,  as  well  as  our  evaluation,  are  contained  in  appendix 
VI. 
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We  are  sending  copies  of  this  report  to  the  Secretaries  of  Defense  and 
the  Navy;  Director,  Office  of  Management  and  Budget;  and  Chairmen, 
House  Committee  on  Government  Operations,  Senate  Committee  on  Gov¬ 
ernmental  Affairs,  and  House  and  Senate  Committees  on  Appropriations 
and  on  Armed  Services. 

CJLMk>  A' 

Charles  A.  Bowsher 
Comptroller  General 
of  the  United  States 
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The  attack  submarine  is  one  of  the  nation’s  most  important  antisubma¬ 
rine  warfare  assets.  The  Los  Angeles  class  nuclear  attack  submarine 
(SSN  688  class)  was  originally  designed  for  antisubmarine  and 
antisurface  ship  warfare  missions.  The  Navy,  however,  expanded  the 
role  of  this  class  by  adding  surveillance,  strike  warfare,  and  mine  war¬ 
fare  missions.  In  addition,  new  sonar  and  combat  control  subsystems 
were  needed  to  counter  an  increasing  Soviet  threat.  Thus,  subacs  was 
initiated  to  meet  these  needs  by  integrating  new  and  improved  sonar, 
combat  control,  and  fire  control  subsystems  into  one  major  system  and 
to  provide  a  logical  “building  block”  approach  for  future  combat  system 
improvements. 

We  reviewed  subacs  because  it  is  an  important  and  costly  attack  subma¬ 
rine  improvement  program.  Our  review  objectives  were  to  identify  the 
cost,  schedule,  and  performance  risks  associated  with  the  subacs  pro¬ 
gram  and  using  fiber  optics  and  ceramic  module  technology  in  subma¬ 
rines.  We  evaluated  the  program  in  terms  of  its  impact  on  the  first 
subacs  submarines’  delivery  schedule  and  performance  capability.  The 
frequent  changes  to  the  program  during  our  review  limited  our  ability  to 
effectively  evaluate  subacs  program  costs.  Also,  the  technical  complex¬ 
ity  of  the  changes  to  system  design  affected  our  ability  to  evaluate  the 
specific  performance  requirements  of  individual  subsystems  comprising 
the  subacs  Basic  combat  system.  Our  review,  therefore,  was  limited  to 
the  overall  cost,  schedule,  performance,  and  program  status  of  the 
subacs  Basic  system. 

Our  review,  in  accordance  with  generally  accepted  government  auditing 
standards,  was  performed  from  October  1984  through  July  1986.  Our 
audit  work  was  conducted  at  the  Naval  Sea  Systems  Command  and  Pro¬ 
gram  Director  of  Attack  Submarine  Acquisition  Programs  offices, 
Arlington,  Virginia;  Offices  of  the  Secretaries  of  Defense  and  Navy, 
Washington,  D.C.;  the  Naval  Underwater  Systems  Center,  Newport, 
Rhode  Island;  IBM  Corporation,  Federal  Systems  Division,  Manassas,  Vir¬ 
ginia;  Hughes  Aircraft  Company,  Ground  Systems  Group,  Fullerton,  Cal¬ 
ifornia;  Raytheon  Company,  Submarine  Signal  Division,  Portsmouth, 
Rhode  Island;  and  General  Dynamics  Corporation,  Electric  Boat  Divi¬ 
sion,  Groton,  Connecticut.  The  work  performed  at  each  of  these  organi¬ 
zations  follows. 

•  The  Program  Director  of  Attack  Submarine  Acquisition  Programs  (desig¬ 
nated  PDS  350)  is  responsible  for  overall  management  of  attack  subma¬ 
rine  programs.  The  Submarine  Combat  Systems  Project  Office  (PMS  409) 
reports  to  PDS  350  and  is  responsible  for  management  and  funding 
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accountability,  development,  acquisition,  and  life-cycle  support  for  the 
subacs  system.  We  examined  Navy  records,  including  documents  on  the 
decision  to  use  a  three-phased  program  approach,  program  require¬ 
ments,  funding  statements,  and  program  progress  reports.  We  inter¬ 
viewed  Navy  officials  regarding  the  cost,  schedule,  and  performance 
status  of  the  program,  including  replanning  activities.  We  also  discussed 
subacs  matters  with  the  Project  Office’s  engineering  and  support  con¬ 
tractor  (EG&G  Analytical  Services  Center,  Inc.,  Arlington,  Virginia) 

•  The  Naval  Underwater  Systems  Center  (nusc),  the  Technical  Direction 
Agent  for  subacs,  provides  technical  direction  and  guidance  to  subacs 
contractors  and  assists  the  Project  Office  in  technical  and  design 
reviews.  To  identify  program  risks,  we  examined  nusc  briefing  material, 
documents,  reports,  and  subacs  technical  risk  assessments.  We  inter¬ 
viewed  nusc  officials  regarding  the  assessments,  evaluations  of  subacs 
technical  risks,  and  program  alternatives. 

•  ibm,  the  subacs  prime  contractor,  is  responsible  for  designing,  develop¬ 
ing,  and  producing  some  subacs  equipment  and  testing  and  integrating 
all  subacs  equipment  and  software,  ibm  also  designed  some  ceramic  mod¬ 
ules  for  data  bus-related  equipment.  We  analyzed  cost  performance 
reports,  progress  reports,  briefing  materials,  contract  records,  and 
related  documentation  used  for  tracking  system  progress.  We  inter¬ 
viewed  ibm  officials  responsible  for  subacs  development  and  obtained 
forecasts  of  the  test  and  integration  schedules  for  system  hardware  and 
software. 

•  Hughes  Aircraft  Corporation,  a  major  subcontractor,  is  responsible  for 
developing  and  producing  the  subacs  weapons  launch  system  and  analog 
modules  for  the  Submarine  Active  Detection  Sonar  receive  group.  Ray¬ 
theon  is  the  Navy  prime  contractor  for  the  Submarine  Active  Detection 
Sonar  transmit  equipment  and  an  ibm  subcontractor  for  combat  control 
software  and  computer  console  equipment.  Raytheon  also  designed  and 
produces  ceramic  modules  for  subacs  equipment.  At  each  location,  we 
examined  and  analyzed  cost  performance  and  progress  reports,  con¬ 
tracts,  and  other  related  documentation  on  the  contractor’s  progress  in 
achieving  cost,  schedule,  and  technical  milestones.  We  interviewed  con¬ 
tractor  managers  on  these  matters. 

•  Electric  Boat  Division  of  General  Dynamics  Corporation  is  the  ship¬ 
builder  for  the  first  two  SSN  688  suBACS-equipped  submarines.  We  dis¬ 
cussed  the  impact  of  Replan  III  on  those  submarines  under  construction 
with  Electric  Boat’s  SSN  688  Program  Manager. 

We  also  discussed  the  cost,  schedule,  and  performance  problems  with 
Navy  officials  of  two  committees,  appointed  by  an  assistant  secretary  of 
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the  Navy  during  spring  1985,  who  conducted  studies  of  the  subacs  pro¬ 
gram.  These  committees  evaluated  the  Navy’s  solutions  to  the  subacs 
problems.  They  also  identified  alternative  ways  for  minimizing  the  risks 
in  meeting  the  delivery  schedule  for  the  first  suBACS-equipped  subma¬ 
rine,  SSN  751. 
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1976-1977 

The  Navy  began  to  study  ways  to  improve 
SSN  688  class  combat  control  systems. 

1978 

The  Navy  reviewed  three  combat  system 
designs:  (1)  the  Federated  Combat  System, 
a  top-down  analysis  of  combat  control  opera¬ 
tional  needs  and  functional  requirements,  (2) 
an  ongoing  improvement  program  for  the 
sonar  (AN/BQQ-5)  and  fire  control  systems 
that  were  in  the  fleet,  and  (3)  the  Re-Engi¬ 
neered  Combat  System,  a  bottom-up  appli¬ 
cation  of  new  technology  for  existing  sonar 
and  fire  control  systems. 

September  1979 

The  Assistant  Secretary  of  the  Navy  for 
Research,  Engineering  and  Systems  directed 
that  funding  for  the  Federated  and  Re-Engi¬ 
neered  Combat  Systems  programs  be 
deferred  and  that  the  Naval  Sea  Systems 
Command  develop  a  single  program  to  meet 
both  future  SSN  688  and  Trident  classes 
applications. 

April  1980 

The  Navy  issued  the  Operational  Require¬ 
ment  document  for  SUBACS. 

November  1980 

The  Navy  approved  the  Mission  Element 
Needs  Statement  for  SUBACS  This  docu¬ 
ment  addressed  the  need  for  an  advanced 
combat  system  that  could  meet  the  changing 
threat  and  mission  requirements  and  still 
have  a  low  life-cycle  cost. 

September  1981 

An  initial  SUBACS  Combat  System  Top-Level 
Requirements  document  was  issued. 

March  1982 

The  Navy  awarded  a  concept  development 
contract  to  the  IBM  Corporation,  Federal  Sys¬ 
tems  Division,  Manassas,  Virginia,  as  the 
SUBACS  prime  contractor,  following  an  eval¬ 
uation  of  two  competitive  proposals,  the 
other  by  Rockwell  International  Corporation. 

June  1982 

The  Vice  Chief  of  Naval  Operations  approved 
the  three-phased  Pre-Planned  Product 
Improvement  program  for  SUBACS,  with 
planned  initial  installation  on  a  fiscal  year 

1983  authorized  submarine,  SSN  751 . 

January  1983 

The  Secretary  of  the  Navy  approved  the 
three-phased  SUBACS  program  through  the 
first  Department  of  the  Navy  Systems  Acqui¬ 
sition  Review  Council  (DNSARC). 

March  1983 

Approval  was  received  from  the  Under  Sec¬ 
retary  of  Defense  for  Research  and  Engineer¬ 
ing  to  expend  long  lead  funds  for  the 

SUBACS  Basic  engineering  development 
model  and  the  fiscal  year  1983  ship  sets 
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April  1983 

A  Naval  Material  Command  audit  of  the 
SUBACS  Basic  program  estimated  a  $105 
million  increase  over  the  Navy's  initial  esti¬ 
mate  of  $657  million. 

July  1983 

The  second  SUBACS  DNSARC  approved  the 
SUBACS  program  plan  and  authorized  pro¬ 
ceeding  to  a  Defense  Systems  Acquisition 
Review  Council  (DSARC)  l/IIA. 

The  first  Decision  Coordinating  Paper  was 
issued  for  SUBACS 

September  1983 

A  DSARC  was  held  on  SUBACS  program 
milestones  l/IIA.  It  recommended  approval  of 
SUBACS  Basic  full-scale  development, 
SUBACS  A  concept  definition,  and  SUBACS 

B  concept  development. 

October  1983 

The  Secretary  of  Defense  approved  the 
SUBACS  three-phased  program  with  pro¬ 
curement  concurrent  with  development  of 
the  Basic  phase  for  attack  submarines  autho¬ 
rized  in  fiscal  years  1983  through  1985. 

December  1983 

The  Navy  awarded  IBM  a  $772  million  cost- 
plus-award  fee  contract  modification  to  the 
1982  contract  for  full-scale  development  of 
SUBACS  Basic  and  production  of  five  ship 
systems,  and  an  engineering  development 
model. 

The  first  SUBACS  Selected  Acquisition 

Report  was  issued. 

January  1984 

The  Navy  established  the  Office  of  the  Pro¬ 
gram  Director  of  Attack  Submarine  Acquisi¬ 
tion  Programs  (PDS  350)  to  manage  the  SSN 
688  class  and  SSN  21  class  attack  subma¬ 
rines  and  SUBACS  programs. 

April  1984 

A  third  DNSARC  convened  to  review 

SUBACS  Basic  status  and  funding  It 
approved  SUBACS  A  design  definition  and 
SUBACS  B  concept  definition.  Because  of 
SUBACS  Basic  cost  problems  it  also 
approved  changes  to  the  overall  Pre-Planned 
Product  Improvement  program,  including 
delays  in  the  delivery  of  SUBACS  A  software 
and  deferral  of  the  land-based  test  facility  to 
the  SUBACS  B  time  frame. 

June  1984 

IBM  established  a  "Red  Team"  to  review 
SUBACS  Basic  progress  and  recommend 
improvements  to  the  IBM  development 
program. 

August  1984 

The  Navy  Program  Director  of  Attack  Subma¬ 
rine  Acquisition  Programs  began  an  internal 
review,  "Zero  Base  Audit,"  of  the  SUBACS 
program.  The  audit  was  completed  in  Sep¬ 
tember  1984. 
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October  1984 


Based  on  the  results  of  the  Zero  Base  Audit, 
the  Navy  determined  that  an  $853  million 
increase  was  required  in  Research,  Develop¬ 
ment,  Test  and  Engineering  funding  for  the 
SUBACS  program  in  the  fiscal  year  1985  Five 
Year  Defense  Program. 


The  Navy  began  its  SUBACS  Basic  replan¬ 
ning  effort  (Replan  I)  as  a  result  of  ceramic 
modules  production  problems. 


December  1984 

The  distributed  system  data  bus  experienced 
problems  in  meeting  initial  critical  item  tests 

December  1984-February  1985 

The  Navy  initiated  Replan  II  because  of  data 
bus  critical  item  test  results,  further  problems 
with  ceramic  modules  production,  and  sys¬ 
tem  cost. 

March  1985 

Replan  III,  which  deleted  the  distributed  sys¬ 
tem  data  bus  from  the  program  and  replaced 
it  with  a  AN/UYK-7  (later  AN/UYK-43)  stand¬ 
ard  computer-based  processing  system,  was 
developed. 

Replan  III  was  initiated  to  stay  within  the 
overall  fiscal  year  1985  Five  Year  Defense 
Program  funding  levels  and  maintain 
schedule. 

April-May  1985 

The  Assistant  Secretary  of  the  Navy  for 
Research,  Engineering  and  Systems  estab 
lished  the  first  committee  to  review  SUBACS 
The  committee  recommended  a  "BQQ-5 

Like"  combat  system  for  SUBACS. 

May-June  1985 

The  Assistant  Secretary  of  the  Navy  for 
Research,  Engineering  and  Systems 
requested  on  May  31, 1985,  additional  infor¬ 
mation  on  the  cost  and  schedule  impacts  of 
"BQQ-5  Like"  and  Replan  III  systems  A  sec¬ 
ond  committee,  established  by  the  NAVSEA 
Command  to  develop  this  data,  reported  that 
the  Replan  III  system  was  the  preferred  alter¬ 
native  because  it  would  have  less  of  an 
impact  on  program  implementation  than  the 
"BQQ-5  Like"  system.  The  committee  indi¬ 
cated  that  the  "BQQ-5  Like"  system  would 
impose  significant  submarine  delivery  delays 
and  increased  costs  for  the  SUBACS 
program. 

August  1985 

The  Assistant  Secretary  of  Navy  for 

Research,  Engineering  and  Systems 
approved  Replan  III  for  SUBACS  Basic 

SSN  21  Attack  Submarine  DNSARC  confirms 
restructure  of  the  SUBACS  program  into 
SUBACS  Basic  and  FY  89  Combat  System 
programs. 

Page  21 


GAO/NSIADS6-12  SUBACS  Problems 


subacs  is  a  highly  complex  system,  consisting  of  various  sonar,  signal 
processing,  and  computer  systems;  supporting  equipment;  and  software. 
Software  alone  consists  of  over  4  million  lines  of  code  written  in  1 1  dif¬ 
ferent  computer  languages  and  runs  on  distributed  computer  systems 
with  more  than  200  processors.  The  processors  were  to  be  connected  by 
a  new,  untried  distributed  system  data  bus,  which  would  have  used 
fiber  optic  technology.  Because  of  the  complexity  of  introducing  this 
new  technology  in  submarines,  the  subacs  program  has  incurred  signifi¬ 
cant  cost,  schedule,  and  performance  problems. 


subacs  has  experienced  significant  increases  in  total  program  cost.  Even 
before  the  October  1983  Secretary  of  Defense  program  approval,  an 
April  1983  Naval  Material  Command  audit  found  the  subacs  Basic  phase 
would  cost  an  additional  $105  million  more  than  the  Navy’s  $657  million 
estimate.  In  November  1984,  about  14  months  after  program  approval, 
the  Navy  estimated  that  an  $853  million  increase  was  required  in  the 
fiscal  year  1985  Five  Year  Defense  Program  for  Research,  Development, 
Test  and  Evaluation  funding  for  the  total  subacs  program.  The  increase 
relates  to  11  program  requirements,  such  as  about  $211  million  for 
subacs  Basic,  A,  and  B;  $1 18  million  for  replacing  the  wide  aperture 
array  with  the  large  wide  aperture  array;  and  $135  million  for  the  land- 
based  test  facility. 

The  prime  contractor,  IBM,  estimated  cost  overruns  at  completion  in  the 
full-scale  development  contract  for  subacs  Basic.  For  example,  IBM,  in  its 
June  1984  Cost  Performance  Report,  estimated  a  cost  overrun  of  $6  mil¬ 
lion.  In  March  1985,  the  cost  overrun  had  increased  to  about  $144.6  mil¬ 
lion.  Of  this  amount,  about  $78  million  was  not  included  in  the  $853 
million  increase  discussed  above.  The  major  areas  where  cost  overruns 
occurred  were 

•  $62.4  million  for  developing  software,  redeveloping  a  network  operating 
system,  increasing  test  and  integration  requirements,  and  providing  sys¬ 
tems  engineering  and  program  support; 

•  $55.0  million  for  major  subcontractor  efforts  to  work  around  problems 
caused  by  ceramic  module  production; 

•  $11.4  million  for  reworking  hardware  and  for  providing  additional 
assembly,  test,  and  quality  control  equipment;  and 

•  $  15.8  million  for  general  and  administration  overhead  and  other  related 
costs. 
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The  cost  overrun  reported  by  IBM  in  its  June  1985  Cost  Performance 
Report  increased  by  an  additional  $1.6  million,  or  a  total  of  $146.2 
million. 

As  a  result  of  cost  overruns  identified  in  March  1985,  ibm  is  evaluating 
$46.9  million  in  contract  scope  reductions  that,  if  implemented,  will  par¬ 
tially  offset  contract  cost  overruns.  One  possible  scope  reduction  is  the 
deletion  of  an  engineering  development  model,  which  the  Navy  has  indi¬ 
cated  would  make  it  difficult  to  effectively  test  and  integrate  subacs 
prior  to  delivery  to  the  submarine.  The  second  subacs  committee  consid¬ 
ered  it  necessary  to  have  a  full-time  model  at  the  factory  as  a  risk  reduc¬ 
tion  measure. 


Schedule 


On  February  15,  1985,  nusc  completed  an  assessment  of  the  hardware, 
software,  and  technical  risks  of  delivering  the  first  subacs  to  the  ship¬ 
builder  by  May  1987.  According  to  the  nusc  assessment,  late  deliveries 
of  ceramic  modules  are  a  major  cause  of  many  hardware  schedule 
delays.  These  electronic  circuits  are  used  in  subacs  equipment  to  assist 
in  processing  data.  This  type  of  ceramic  module  is  new  technology  for 
submarines  anchprovides  greater  resistance  to  heat,  more  electronics  per 
square  inch,  and  processes  data  faster  than  conventional  modules. 

The  nusc  assessment  identified  eight  major  subsystems  as  having  a 
medium  to  high  delivery  risk  because  of  development  and  production 
problems  with  ceramic  modules.  For  example,  two  high-risk  hardware 
items — the  weapons  launch  system  and  multipurpose  consoles — are 
scheduled  to  be  delivered  5  months  and  3  months  late.  The  major  rea¬ 
sons  for  late  deliveries  were  vendor  difficulties  in  meeting  Navy  testing 
requirements  and  low  production  yields  of  usable  modules.  Because  of 
problems  with  ceramic  modules,  IBM  had  to  revise  test  and  integration 
schedules.  According  to  EG&G,  the  average  cost  (including  nonrecurring 
costs)  of  all  ceramic  modules,  produced  by  all  vendors,  has  almost 
doubled.  In  commenting  on  our  report,  ibm  stated  the  cost  of  its  ceramic 
modules  increased  by  35  percent. 

The  nusc  assessment  also  stated  that  software  development  and  deliv¬ 
ery  was  a  high  risk.  The  assessment  pointed  out  that  software  develop¬ 
ment  required  for  subacs  is  an  “extremely  ambitious  undertaking." 
consisting  of  over  4  million  lines  of  code  written  in  1 1  different  com¬ 
puter  languages.  The  software  runs  on  distributed  computer  systems 
containing  more  than  200  processors  linked  together  by  a  new,  untried, 
complex  distributed  system  data  bus.  After  the  software  is  developed,  it 
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Factors  Affecting  Program  Implementation 


Performance 


will  be  tested  with  hardware  at  the  prime  contractor’s  facilities  for  com¬ 
patibility  and  integration  with  other  systems.  The  assessment  stated 
that  the  software  scnedule  would  be  delayed  significantly  because  of 
insufficient  time  to  test,  integrate,  and  revise  software  for  a  very  large 
system.  Further,  the  assessment  concluded  that  software  development 
was  a  high  schedule  risk  because  there  was  no  additional  time  for  code 
growth  or  software  rework  or  for  correcting  anything  that  may  go 
wrong  at  the  prime  contractor’s  test  facilities. 

On  March  26,  1985,  IBM  advised  the  subacs  Project  Office  that  it  had 
underestimated  software  schedule  deliveries  by  15  percent.  As  a  result, 
ibm  estimated  that  test  and  integration  for  six  software  deliveries  would 
be  delayed  from  2  months  to  more  than  2  years.  According  to  ibm,  these 
functions,  delayed  more  than  2  years,  comprise  2.3  percent  of  the  total 
software. 


The  distributed  system  data  bus  was  a  major  technological  innovation  in 
the  subacs  program.  The  data  bus  was  being  developed  to  integrate 
acoustic  and  combat  control  subsystems  into  one  major  system,  provide 
error-free  communications,  and  allow  the  system  to  process  more  data 
at  higher  speeds  than  previous  systems.  The  system  would  have 
included  other  innovations  such  as  displaying  real-time  data  on  common 
display  consoles. 

N use's  assessment  assigned  a  high  technical  risk  to  developing  the  data 
bus  because  during  preliminary  critical  item  tests  it  operated  at  one- 
sixth  the  speed  originally  planned.  In  addition,  units  that  interfaced 
with  the  data  bus  had  to  be  redesigned  due  to  ceramic  module  delays. 
The  delays  were  due  to  vendor  difficulties  in  meeting  Navy  testing 
requirements  and  low  production  yields.  According  to  the  assessment, 
these  technical  problems  resulted  in  an  extremely  tight  development 
schedule,  with  "virtually  no  margin  for  error.” 

An  ibm  official  advised  us  that  most  of  the  problems  with  the  data  bus 
were  due  to  poor  implementation  of  the  network  operating  system 
design.  The  original  system  was  too  complex,  and  the  data  bus  was 
eventually  taken  out  of  subacs  primarily  because  of  performance  and 
funding  considerations. 

One  ibm  subcontractor,  Hughes  Aircraft,  has  encountered  problems 
designing  another  type  of  module,  analog  function  modules,  for  the  Sub¬ 
marine  Active  Detection  Sonar  system  receive  group.  During  a  recent 
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design  review,  the  subcontractor  identified  five  performance  related 
problems.  One  of  these  problems  may  adversely  affect  the  ability  of  the 
first  subacs  submarines  to  effectively  perform  their  missions.  Because 
of  these  performance  problems,  the  subcontractor  has  not  met  required 
production  schedules  and  deliveries  to  the  prime  contractor.  In  addition, 
the  estimated  cost  to  complete  the  Hughes  Aircraft  subcontract  has 
increased  by  $7.2  million. 

In  commenting  on  our  draft  report,  Defense  advised  us  that  problems 
with  analog  function  modules  have  been  solved  and  that  sufficient  mod¬ 
ules  are  on  hand  for  the  first  ship  set.  However,  we  noted  that,  accord¬ 
ing  to  the  nusc  July  13,  1985,  progress  report,  the  Navy  approved  major 
deviations  from  specifications  for  these  modules. 
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The  Navy’s  decision  under  Replan  III  to  delete  the  distributed  system 
data  bus  from  subacs  constituted  a  major  deviation  in  the  design  as  it 
was  originally  planned.  This  decision  created  the  need  to  implement  an 
alternative  data  processing  system  in  sufficient  time  to  meet  the  May 
1987  delivery  of  the  first  subacs  Basic  system  to  the  shipbuilder. 


On  April  24,  1985,  the  Assistant  Secretary  of  the  Navy  for  Research, 
Engineering  and  Systems  appointed  a  high-level  committee  to  review 
Replan  II,  Replan  III,  and  a  new  alternative,  a  “BQQ-5  Like”  combat  sys¬ 
tem.  The  “BQQ-5  Like"  system  would  replace  the  subacs  beamformer 
and  Multi-Array  Signal  Conditioner  with  the  corresponding  BQQ-5  hard¬ 
ware  and  software.  The  committee  reached  the  following  conclusions: 

•  The  subacs  bus  approach  must  be  abandoned. 

•  Replan  III  is  overly  optimistic  because  of  the  low  chance  of  meeting  SSN 
751  delivery  schedules,  because  of  its  unpredictable  cost  and  schedule 
risks,  and  because  it  may  not  achieve  pre-suBACS  combat  system 
capability. 

•  The  “BQQ-5  Like”  architecture  is  recommended  because  of  its  known 
configuration  and  capability  and  its  relatively  predictable  cost  and 
schedule  impact. 

In  addition,  the  committee  identified  several  program  management  prob¬ 
lems,  including  the  following: 

•  The  Navy  management  structure  did  not  provide  the  necessary  focus. 

•  Use  of  fundamental  management  controls  was  not  apparent. 

•  nusc,  the  Navy’s  lead  laboratory  for  subacs,  had  not  provided  strong 
technical  input  to  the  program. 

Although  the  committee  recommended  returning  to  the  “BQQ-5  Like” 
architecture,  it  had  low  confidence  that  the  system  could  be  delivered  to 
Electric  Boat  by  May  1987.  In  addition,  the  committee  did  not  determine 
the  impact  on  shipbuilder  costs  because  the  data  was  not  available.  On 
May  28,  1985,  the  committee  presented  its  recommendations  to  the 
assistant  secretary. 


First  Navy  SUBACS 
Committee 


Second  Navy  SUBACS 
Committee 


On  May  31,  1985,  the  assistant  secretary  requested  more  detailed  infor¬ 
mation  on  the  cost,  schedule,  and  hardware  risks  for  “BQQ-5  Like”  and 
Replan  III  alternatives.  The  navsea  Command  established  a  second  com¬ 
mittee  to  develop  this  information.  Several  changes  were  made  to 
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Replan  III  Approved 


Replan  III  after  the  first  committee  completed  its  review.  These  changes 
included  freezing  the  design  of  a  critical  piece  of  equipment,  thereby 
reducing  software  development;  increasing  the  time  available  for  test 
and  integration  by  adding  additional  test  facilities;  delaying  completion 
of  final  system  design  certification  testing1  until  September  1988  and 
adding  a  critical  acoustic  function  earlier  than  originally  planned.  This 
committee  concluded: 

•  The  ‘‘BQQ-5  Like”  system  could  not  be  delivered  as  rapidly  as  estimated 
by  the  first  committee.  Ship  delivery  delays  would  be  much  greater  for 
the  “BQQ-5  Like”  system  than  the  Replan  III. 

•  Total  costs  of  implementing  the  “BQQ-5  Like”  approach  would  be  six 
times  greater  than  those  of  implementing  Replan  III. 

•  Neither  approach  meets  the  top-level  requirements  of  the  original 
subacs  program;  therefore,  top-level  requirements  need  to  be  revised  to 
reflect  reduced  capabilities. 

•  Replan  III  has  the  potential  to  delay  the  delivery  of  the  first  two  subao 
equipped  submarines. 


On  August  9,  1985,  the  assistant  secretary  approved  Replan  1’'.  Ac  word¬ 
ing  to  the  subacs  Project  Manager,  detailed  program  plans.  -  break¬ 
down  structures,  critical  path  analyses,  and  work  packages  \  dd  e 
completed  for  Replan  III  in  October  1985.  In  addition,  fhe  prtc  am  s  ' 
faces  some  high  risks.  The  chairperson  of  the  second  committee  at-  ! 
that  these  risks  include 

•  developing,  integrating,  and  producing  software  for  the  program,  partic¬ 
ularly  for  one  critical  hardware  item  called  a  common  beamformer; 

•  potential  impacts  to  ship  deliveries; 

•  reduced  capability  at  ship  delivery;  and 

•  delaying  completion  of  system  design  certification  testing  until  after 
.  delivery  of  the  first  subacs  submarine. 


'System  design  certification  testing  is  the  validation  of  a  production  system  for  meeting  performance 
requirements  before  it  is  accepted  for  use  on  a  ship. 
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THE  UNDER  SECRETARY  OF  DEFENSE 


WASHINGTON  DC  20301  3010 


2  5  CC'T 


C.  Conahan 

National  Security  and  International  Affairs  Division 
U.S.  General  Accounting  Office 
441  G  Street,  NW. 

Washington,  O.C.  20S48 

Dear  Mr.  Conahan: 

This  Is  the  Department  of  Defense  (DoD)  response  to  the  General  Accounting 
Office  (GAO)  draft  report  entitled  “Submarine  Advanced  Combat  System  Problems 
May  Adversely  Affect  Navy  Attack  Submarine  Programs",  dated  September  23,  1985 
(GAO  Code  No.  394030  -  OSD  Case  No.  6842). 

The  DoD  generally  agrees  with  the  GAO  findings.  The  DoD  also  generally 
agrees  with  the  GAO  recomnendations,  with  the  exception  of  delaying  release  of 
FY  1986  funding.  The  Defense  Systems  Acquisition  Research  Council  (DSARC)  Is 
scheduled  to  review  the  Submarine  Advanced  Combat  System  Program  in  November 
1985.  The  Navy  has  been  asked  to  provide  key  program  documentation,  budget 
quality  estimates,  and  review  the  program's  progress  at  that  briefing. 

The  detailed  DoD  comments  on  the  findings  and  recommendations  are  provided 
In  the  enclosure.  The  Department  appreciates  the  oportunity  to  comment  on  the 
draft  report. 

Sincerely, 


Donald  A.  Hicks 

Enclosure 


RESEARCH  AND 
ENGINEERING 

( TWP ) 


Mr.  Frank 
Director, 
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'SUBMARINE  ADVANCED  COMBAT  SYSTEM  PROBLEMS  NAY  ADVERSELY 
AFFECT  NAVY  ATTACK  SUBMARINE  PROGRAMS' 


000  COMMENTS  TO  THE  GAO  DRAFT  REPORT 
***** 

FINDINGS 

FINDING  A:  Cost  Problems  in  The  Sub—  fine  Advanced  Combat  System  (SUBACS) 

Program.  "  GAfl  found  that  cost  control  has  been  a  continuing  problem  In  the 
SUBAcs  program,  resulting  In  significant  cost  Increases.  According  to  GAO, 
even  before  the  October  1983  Secretary  of  Defense  program  approval,  an  April 
1983  Naval  Material  Conmand  audit  found  that  the  SUBACS  Basic  phase  was 
underestimated  by  about  $105  million.  After  the  contract  was  negotiated  with 
International  Business  Machines  (IBM)  Corporation  In  December  1983,  GAO 
reported  that  In  June  1984,  the  Navy  decided  to  delay  several  portions  of  the 
SUBACS  development  program  to  absorb  early  cost  Increases  estimated  by  IBM. 

GAO  found  that  an  additional  cost  problem  was  Identified  in  November  1984  when 
the  Navy  estimated  the  total  SUBACS  program  would  require  $853  million  more  In 
RDTJE  funding  due  to  new  and  unfunded  requirements,  program  stretchouts 
resulting  from  budget  cuts,  future  funding  needs,  and  cost  overruns  In  the 
SUBACS  Basic  contract.  Although  the  Navy  restructured  the  development  program 
to  address  this  problem,  GAO  found  that  SUBACS  costs  have  continued  to 
escalate.  GAO  reported  that  in  June  1985,  IBM  estimated  a  $146.2  million  cost 
overrun  to  complete  SUBACS  Basic  full-scale  development,  about  $78  million  of 
which  was  not  Included  In  the  November  1984  Navy  estimate.  GAO  noted  that  the 
June  1985  overrun  was  primarily  due  to  increased  software  and  system 
development,  additional  test  and  integration  requirements,  and  subcontractor 
..  .  .  .  and  vendor  production  problems.  According  to  GAO,  IBM  Is  currently  evaluating 

mow  on  pp.  o-4.  ana  $46.9  million  In  contract  scope  reductions  to  partially  offset  the  cost 

20-21.  overruns,  (pp.  4-5,  Letter,  and  pp.  11-12,  Appendix  IV,  GAO  Draft  Report) 

OOP  POSITION:  Partially  concur.  DoD  concurs  except  that  the  GAO  Incorrectly 
states  that  I8M  estimated  a  $146.2  million  cost  overrun  in  June  1985,  stating 
that  this  estimate  showed  that  costs  continued  to  escalate  after  the  Navy  had 
restructured  the  program  to  contain  costs.  In  fact,  the  IBM  estimate  was 
known  to  the  Navy  before  the  restructuring  and  formed  part  of  the  basis  for 
the  Navy-Initiated  scope  reduction  effort.  The  IBM  estimate,  therefore,  does 
not  reflect  poor  performance  of  the  restructured  program.  Additionally,  since 
the  GAO  audit  was  completed,  the  Secretary  of  the  Navy  has  approved  the 
contract  scope  reductions  discussed  in  the  last  sentence  of  this  finding. 
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Now  on  pp.  1-2,  4-5.14, 
and  21-22. 


FINDING  8:  Schedule  Problems  Affecting  The  SUBACS  Program.  GAO  reported  that 
in  October  1983,  the  secretary  of  Defense  approved  the  Navy’s  plan  to 
Introduce  SUBACS  as  a  three-based  Pre-planned  Product  Improvement  program 
rather  than  a  single  phase  program  as  originally  planned.  Under  this  new 
approach,  GAO  reported  that  SUBACS  was  to  be  Introduced  on  SSN  751,  an  SSN  688 
class  submarine  authorized  In  fiscal  year  1983  and  scheduled  for  delivery  In 
November  1987,  rather  than  a  submarine  scheduled  for  authorization  In  fiscal 
year  1989.  Although  designed  to  Introduce  additional  capabilities  earlier 
than  planned  and  spread  program  risks  and  costs  over  time,  GAO  found  that  In 
fact  the  schedules  provided  little  flexibility  to  deal  with  problems  normally 
encountered  when  Introducing  new  and  unproven  technology  through  a  concurrent 
development  and  production  program.  GAO  reported  that  as  early  as  June  1983, 
a  Naval  Underwater  Systems  Center  (NUSC)  risk  assessment  predicted  that 
development  of  the  distributive  system  data  bus  was  a  high  risk  and  would  be 
completed  9  to  12  months  later  than  scheduled  to  meet  delivery  of  the  SSN  751. 
GAO  found  that  a  February  1985  NUSC  risk  assessment  Identified  eight  major 
hardware  subsystems  as  a  medium  to  high  risk  for  delayed  delivery  to  the 
shipbuilder,  and  that  software  development  was  also  a  high  schedule  risk.  GAO 
also  noted  that  In  February  1985,  IBM  estimated  six  critical  software 
deliveries  would  be  delayed  from  2  months  to  more  than  2  years,  (pp.  2  and 
5-6,  Letter;  p.  5,  Appendix  II;  and  pp.  13-14,  Appendix  IV,  GAO  Draft  Report) 

POO  POSITION:  Concur. 

-  The  GAO  report  gives  much  emphasis  to  the  June  1983  NUSC  risk 
assessment  which  predicted  delays  In  development  of  the  distribution 
data  bus.  In  retrospect,  NUSC  was  correct.  It  should  be  recognized, 
however,  that  risk  assessments  from  various  sources,  Including  Bell 
Laboratories,  were  considered  in  reaching  decisions  on  this  program. 
Hhlle  none  claimed  the  development  was  risk-free,  the  aggregate  showed 
the  risk  was  acceptable,  particularly  when  recommended  additional 
modeling  and  testing  was  Incorporated  Into  the  program.  To  mention 
only  the  assessment  which  (In  retrospect)  proved  correct  Is  to  mislead 
the  reader  to  believe  that  overwhelming  evidence  of  impending  risk  was 
Ignored  by  the  decision-makers,  which  was  not  the  case. 

-  The  February  1985  NUSC  hardware  risk  assessment,  comnlssioned  by  the 
program  Office,  was  a  primary  consideration  In  defining  Replan  III. 
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Now  on  p.  5  and  22-23. 


Now  on  pp.  10  and 
16-17. 


FINOING  C:  SUBACS  Program  Performance  Problems.  GAO  reported  that  the 
distributive  system  data  bus  was  a  major  technological  Innovation  In  the 
SUBACS  program,  Intended  to  Integrate  acoustic  and  combat  control  subsystems 
into  one  major  system,  provide  error-free  conwunlcatlons,  and  process  more 
data  at  higher  speed.  GAO  found  that  preliminary  critical  Items  tests  by  IBM 
In  December  1984  showed  that  the  software  system  for  the  data  bus  processed 
data  about  six  times  slower  than  the  original  program  requirements  which, 
according  to  NUSC,  would  prevent  combat  system  operators  from  receiving. 
Interacting,  and  responding  to  acoustic  Information  fast  enough  to  solve 
combat  problems  on  a  real  time  basis.  GAO  also  reported  that  one  IBM 
subcontractor,  Hughes  Aircraft,  has  encountered  problems  designing  modules  for 
the  submarine  active  detection  sonar  system,  one  of  which  may  adversely  affect 
the  ability  of  the  first  SUBACS  submarines  to  perform  their  missions.  Based 
on  Its  analysis,  however,  GAO  concluded  that  development  of  the  data  bus  and 
Its  associated  software  is  the  most  serious  performance  problem  affecting 
SUBACS  Implementation,  (p.  6,  Letter;  and  pp.  14-15,  Appendix  IV,  GAO  Draft 
Report) 

OOP  POSITION:  Concur.  The  modules  mentioned  In  the  GAO  report  are  for  the 
receive  group  of  the  sonar.  Problems  with  these  modules  and  with  the  ceramic 
modules  have  been  solved  and  all  modules  for  the  first  ship  set  are  on  hand. 

FINDING  D;  Other  Factors  Contributing  To  Program  Problems.  GAO  Identified 
two  other  factors  that  have  contributed  to  SUBACS  program  problems.  First, 

GAO  found  that  the  Navy's  decision  to  accelerate  ship  delivery  schedules  for 
the  first  two  SUBACS-equIpped  submarines  has  reduced  the  time  available  for 
Installation  of  the  SUBACS  Basic  system  from  12  months  to  5  months  before 
delivery  of  SSN  751.  The  second  factor  Identified  by  GAO  relates  to  the 
Navy's  management  of  the  program.  According  to  GAO,  a  high  level  committee 
report  In  1985  stated  that  the  Navy's  management  structure  provided  neither 
the  necessary  focus  nor  the  effective  use  of  program  management  control 
procedures.  GAO  also  pointed  out  that,  according  to  the  report,  NUSC  has  not 
provided  a  strong  technical  Input  to  the  development  program,  (pp.  6-7, 
Letter;  and  pp.  16-17,  Appendix  V,  GAO  Draft  Report) 

POD  POSITION:  Concur.  NAVSEA  and  NUSC  are  currently  restructuring  their 
respective  organizations  for  both  the  SUBACS  and  FY  1989  Combat  System 
Programs.  Both  comnands  are  defining,  In  concert,  responsibilities,  lines  of 
communication,  and  accountability  to  ensure  proper  roles  are  established  and 
performed.  This  effort  will  be  completed  and  the  structure  In  place  by 
November  1,  1985. 
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Now  on  pp.  7-8,  9-10, 
and  24. 


Now  on  pp  8-9  and 
24-25 


FINDING  E:  Navy  Actions  To  Replan  The  SUB ACS  Program.  To  address  the 
problems  experienced  in  the  SUBACS  Basic,  GAO  reported  that  the  Navy  and  IBM 
revised  the  program  plan  several  times  between  October  1984  and  May  1985. 
According  to  GAO,  Replans  I  and  II  were  developed  In  late  1984  and  early  1985 
respectively,  but  both  were  displaced  by  Replan  III,  initiated  in  March  1985. 
GAO  found  that  Replan  III  had  the  most  significant  impact  on  SUBACS  design 
since  it  deleted  the  data  bus  entirely  from  the  program  and  proposed  replacing 
it  with  a  standard  computer-based  processing  system.  Further,  GAO  reported 
that  because  of  the  problems  encountered  during  SUBACS  Basic,  the  SUBACS  A  and 
B  phases  have  been  deferred  until  1989  or  later.  In  effect,  GAO  noted  that 
Replan  III  would  convert  the  three-phased  SUBACS  program  to  a  one-phase  effort 
for  all  SSN  688  class  submarines  authorized  from  fiscal  years  1983  through 
1988.  GAO  concluded  that  this  system  will  have  less  capability  than  the 
system  originally  planned  and  approved  by  the  Secretary  of  Defense,  (pp.  7-8 
and  11,  Letter;  and  p.  16,  Appendix  V,  GAO  Draft  Report) 

POO  POSITION;  Partially  concur.  The  SUBACS  A  and  B  phases  were  not  “deferred 
until  1989  or  later,"  but  were  combined  into  the  FY  1989  Combat  System.  The 
three  phases  planned  for  1983/4/5,  1986/7/8  and  1989  and  later,  were  converted 
to  a  two-phase  program  with  SUBACS  Basic  for  the  1983-1989  submarines  and  the 
FY  1989  Combat  System  for  the  1989  and  later  submarines,  including  SSN  21. 

FINDING  F:  Navy's  Review  of  Replan  HI.  GAO  reported  that  because  Replan  III 
was  a  major  design  change  to  SUBACS,  on  April  24,  1985,  the  Assistant 
Secretary  of  the  Navy  for  Research,  Engineering  and  Systems  appointed  a  high 
level  committee  to  review  the  program.  According  to  GAO,  in  its  report  of  May 
28,  1985,  the  committee  agreed  with  the  Replan  III  proposal  to  delete  the  bus, 
but  reconmended  an  alternative  combat  system,  the  BQQ-5  Like,  similar  to  those 
deployed  on  SSN  688  class  submarines.  GAO  pointed  out  that  the  committee 
believed  Replan  III  was  overly  optimistic,  had  a  low  chance  of  meeting 
delivery  schedules,  and  had  unpredictable  cost  and  schedule  risks.  GAO 
reported  that  a  second  committee  was  then  established  to  develop  more  detailed 
information  on  cost  and  schedule  impacts,  and  on  July  1  concluded  that  (1) 
neither  BQQ-5  Like  or  the  revised  Replan  III  alternatives  would  meet  the 
original  SUBACS  performance  requirements;  (2)  the  cost  increase  of 
implementing  the  BQQ-5  Like  alternative  was  six  times  greater  than  the 
increase  under  Replan  III;  and  (3)  the  BQQ-5  Like  would  have  a  greater  adverse 
impact  on  ship  delivery  schedules.  According  to  GAO,  the  Assistant  Secretary 
then  approved  Replan  III  on  August  9,  1985.  fpp.  9-10,  Letter;  and  pp.  16-18, 
Appendix  V,  GAO  Draft  Report) 

DTO  POSITION:  Concur.  It  should  be  recognized,  however,  that  the  “BQQ-5 
Like"  system  is  essentially  the  same  system  being  developed  under  SUBACS 
Replan  III,  with  certain  nigh-risk  hardware  replaced  with  proven,  less-capable 
components  from  the  AN/BQQ-5  sonar  system.  The  remaining  hardware,  developed 
under  the  SUBACS  program,  is  still  required,  since  the  combat  system  currently 
deployed  in  688  Class  SSNs  is  too  large  to  fit  in  the  space  allocated  for  the 
combat  system  in  the  FY  1983-88  688  Class  SSNs. 
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Now  on  pp.  9-10  and  25. 


FIWDIW6  6:  Replan  III  l^leaentatfon  Risks.  GAO  identified  several  risks 
which  it  believes  could  adversely  affect  program  implementation.  GAO  reported 
that  according  to  the  SUBACS  Project  Manager,  detailed  program  plans,  work 
breakdown  structures,  critical  path  analyses,  and  work  packages  for  Replan  III 
will  not  be  completed  until  October  1985,  and  that  contract  modifications 
required  to  Implement  Replan  III  must  then  be  negotiated  and  approved.  In 
addition,  GAO  reported  that  the  second  committee  identified  major  technical 
risks  and  uncertainties,  including  problems  with  developing,  Integrating,  and 
producing  system  software.  According  to  GAO,  this  will  cause  the  software  for 
the  first  two  systems  to  be  Incomplete  when  delivered  to  the  shipbuilder, 
which  could  result  in  late  delivery  of  the  first  two  SUBACS-equIpped 
submarines,  and  may  subject  the  Navy  to  costly  shipbuilder  claims.  Further, 
GAO  reported  that  according  to  the  committee,  these  submarines,  at  delivery, 
will  have  a  combat  system  with  less  performance  than  required  under  Replan 
III,  and  that  since  software  test  and  integration  planning  was  Incomplete,  a 
meaningful  assessment  of  schedule  risk  could  not  be  done.  GAO  concluded  that 
because  of  the  changes  made  in  the  SUBACS  program  and  the  risks  and 
uncertainties  Identified  with  the  latest  plan,  the  scheduled  Defense  Systems 
Acquisition  Review  Council  (DSARC)  review  is  needed  to  assure  that  alT 
alternatives  are  fully  considered  to  minimize  SUBACS  cost,  schedule,  and 
technical  performance  problems,  and  lessen  the  potential  adverse  Impacts  on 
the  Navy's  attack  submarine  programs.  Based  on  its  assessment  of  the 
committee  reviews,  GAO  also  concluded  that  all  available  alternatives  were  not 
fully  considered,  such  as  delaying  delivery  of  the  SSNs  751  and  752, 
terminating  the  SUBACS  program,  and  returning  to  the  current  BQQ-5  system,  and 
developing  a  new  distributed  data  bus  system.  Further,  GAO  concluded  that 
lessons  learned  from  the  SUBACS  problems  should  be  applied  in  developing  the 
new  combat  system  for  the  SSN  21.  (pp.  10-12,  Letter;  and  p.  18,  Appendix  V, 
GAO  Draft  Report) 

OOP  POSITION:  Partially  concur.  DoD  concurs  except  for  the  conclusion  that 
all  available  alternatives  were  not  fully  considered.  The  alternatives,  such 
as  delaying  the  SSNs  751  and  752,  terminating  the  SUBACS  program  and  returning 
to  the  current  BQQ-5  system,  and  developing  a  new  distributed  data  bus  system, 
were  considered.  Although  In  retrospect  the  options  should  have  been 
Included,  the  prohibitive  cost  and  serious  operational  Impact  were  so 
unacceptable  that  they  were  not  seriously  considered  or  mentioned  In  the 
committees'  reports. 
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Now  on  p.  11. 


Appendix  V 

Comments  From  the  Department  of  Defense 


RECOMMENDATIONS 

RECOMMENDATION  1:  GAO  recomnended  that  the  Secretary  of  Defense,  through  the 
DSARC  review  process,  evaluate  the  Navy's  justification  for  adopting  Replan 
III  from  among  alternative  acquisition  strategies  to  ensure  the  best  course  of 
action  is  taken  for  providing  SSN  688  class  submarines,  near-  and  long-term, 
with  the  needed  combat  system  performance,  while  minimizing  the  adverse 
effects  on  SU8ACS  and  submarine  construction  costs,  schedules,  and  contracts, 
(p.  12,  GAO  Draft  Report) 


000  POSITION: 


A  DSARC  Program  Review  is  scheduled  for  November  1985. 


RECOMMEtCATION  2:  GAO  recomnended  that  the  Secretary  of  Defense,  through  the 
DSARC  review  process,  condition  approval  of  the  program  on  the  establishment 
of  a  plan  for  management  control.  Including  specific  criteria,  reporting 
requirements,  and  periodic  reviews  of  the  program  adopted  to  assess  the 
progress  in  reaching  SU8ACS  program  objectives,  (p.  13,  GAO  Draft  Report) 

POO  POSITION:  Concur.  This  will  be  done  through  the  DSARC  process. 

RECOMMENDATION  3:  GAO  recomnended  that  the  Secretary  of  Defense,  through  the 
DSAT„  review  process,  require  the  Navy  to  provide  key  program  documentation 
and  budget  quality  cost  estimates  before  releasing  fiscal  year  1986  program 
funds,  and  base  the  future  release  Of  funds  on  demonstrated  program  progress, 
(p.  13,  GAO  Draft  Report) 

POO  POSITION:  Partially  concur.  As  stated  above,  the  SUBACS  program  will  be 
reviewed  by  the  DSARC  in  November  -985.  The  Navy  will  be  required  to  provide 
key  program  documentation  and  budget  quality  cost  estimates  for  the  DSARC 
review.  DoO  does  not,  however,  agree  that  fiscal  year  1986  program  funds 
should  be  withheld.  The  Navy  will  limit  the  funding  for  the  program  as 
required  by  the  continuing  resolution.  To  withhold  release  of  fiscal  year 
1986  program  funds  before  the  DSARC  review  would  result  in  stop-work  orders, 
costly  termination/restart  proceedings,  and  guarantee  further  costly  delays  in 
a  program  with  an  already  ambitious  schedule.  The  Navy  is  pursuing  the 
limitation  of  government  liability  on  the  IBM  contract  as  directed  by  the 
Joint  Committee  Report  on  Defense  Authorizations.  Capping  of  the  contract  is 
expected  to  be  complete  by  February  1,  1986,  as  directed. 
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October  24,  1985 


In  Reply  Refer  To:  85-CCA- IBM-02999 


United  States  General  Accounting  Office  (GAO) 
Washington,  DC  20548 


Ml  (.ixlnm  l)riv<-.  Manama-.  Nirijinid  J2IIO 


Attention: 
Subject : 

Attachment : 

Dear  Sir: 


Mr,  F.  Conahan 

IBM  Response  to  the  Draft  GAO  Report 
on  the  Submarine  Advanced  Combat  System, 
GAO  Code  394030  dated  September  1985 

IBM  Comments  on  GAO  Report  r-40  Code  394030 
dated  September  1985 


IBM  appreciates  this  opportunity  to  provide  the  enclosed  comments 
to  the  General  Accounting  Office  Report  on  the  SubACS  Program.  In 
order  to  make  your  review  of  our  comments  more  convenient  the 
attachment  is  formatted  to  first  restate  the  sentence  or  paragraph 
in  the  GAO  Report  followed  by  our  comment.  We  hope  the  information 
provided  herein  will  be  helpful  to  you  in  writing  yoiir  final  report. 

If  you  have  any  questions  or  wish  to  have  further  discussion  relative 
to  this  matter  please  contact  me  on  (703)  367-4268. 


CN. _ 

G.Tj.  Houser 


Attachment 
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GENERAL  COMMENT: 

Although  the  report  is  generally,  factually  accurate  for  the  time  period 
for  which  it  was  written,  many  of  the  issues  highlighted  as  problems  are 
no  longer  applicable  as  risk  factors  to  the  program.  Program  redirection 
implementation  progress  and  problem  resolution  which  have  occurred  since 
June  1985  permit  the  program  to  meet  the  ship  delivery  (5/87)  and  ship 
deployment  (9/88)  requirements  on  schedule. 

The  following  specific  comments  address  points  IBM  believes  need  to  be 
clarified  and  expanded  upon  to  reflect  present  status,  problem  correction, 
and  additional  information  which  have  resulted  during  the  six  months  since 
the  data  for  the  report  was  gathered. 

In  summary,  IBM  believes  that  the  current  program  plan  and  status  support 
Navy  delivery  requirements. 
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Now  on  p  3 


See  GAO  comment  1 


Now  on  p  4 


See  GAO  comment  2 


1.  Page  4,  Paragraph  3 

"Moreover,  a  S3. 8  Million  increase  to  the  contract  was  estimated  in  IBM's 
first  SubACS  Basic  cost  performance  report  in  March  1984.  To  absorb  the 
increased  costs  in  SubACS  Basic  the  Navy  in  June  1984  decided  to  delay 
several  portions  of  the  overall  SubACS  development  program." 

IBM  Cownent 

The  first  Cost  Performance  Report  submitted  after  contract  award  showed  a 
J3.8M  growth  in  factory  costs  at  completion.  It  also  showed  an  unassigned 
budget  line  of  S5.9M  set  aside  as  a  management  reserve.  This  could  have 
been  used  tv  -ffset  the  growth.  IBM  is  not  aware  of  Navy  plans  in  June  1984 
to  delay  portions  of  the  development  program.  At  that  time,  we  were  fully 
funded  and  performing  to  the  total  contract  scope. 


2.  Page  5,  Paragraph  1 

"While  about  $68.2  million  of  this  increase  was  accounted  for  in  the 
November  1984  estimate,  $78  million  was  not." 

IBM  Conment 

IBM  was  not  privileged  to  know  and  did  not  have  input  to  the  $853  million 
number  and  therefore  can  neither  verify  nor  dispute  those  numbers.  Later 
reference  is  made  to  $853  million  increase  in  R&D  and  the  fact  that  it  did 
not  include  $78  million  of  IBM’s  increase.  It  is  not  known  why  the  total 
increase  was  not  account*.!  for. 


Page  37 


GAO/NSIAD-86-12  SUBACS  Problems 


Appendix  VI 

Comments  Prom  International  Business 
Machines  Corporation 


Now  on  p.  5 


See  GAO  comment  3. 


Now  on  p.  5 


See  GAO  comment  4 


3.  Page  6,  Paragraph  1 

"In  addition,  IBM  estimated  in  February  1985  that  six  critical  software 
deliveries  would  be  delayed  from  2  months  to  more  than  2  years  because  of 
insufficient  time  to  test,  integrate,  and  modify  system  software." 

IBM  Comment 

The  original  program  plan  for  development  included  partitioning  the  software 
functions  into  seven  drops  and  completely  integrating  to  support  a  full 
system  delivery  in  May  1987.  In  February,  1985,  IBM  completed  a  detailed 
assessment  of  the  System  Integration  activity  and  concluded  that  there  was 
Insufficient  time  remaining  to  integrate  and  test  100%  of  the  SubACS  Basic 
function  as  defined  in  the  November  1983  Prime  Item  Development  Specification. 
The  full  system  functions  were  prioritized  with  individual  integration  times 
assigned.  The  prioritized  list  was  broken  into  three  segments,  or  deliveries; 
May  1987,  September  1988,  and  post  1988.  The  seven  software  drops  were 
mapped  against  the  priorities  and  consequently  rescheduled.  The  six  lowest 
priority  functions  were  identified  as  "Category  11“  functions  and  delayed 
beyond  the  Ship  Deployment  delivery.  These  functions  were  mutually  agreed  to 
be  lowest  priority  and  represent  92.5  KSLOCS  of  software  of  the  total 
4000  KSLOCS  or  approximately  2.3%  of  the  software.  After  one  function 
(HF  PPS)  was  added  back  into  September  1988  delivery,  the  Navy  agreed  that 
the  remaining  Category  II  functions  were  not  critical  to  mission  performance. 

4.  Page  6,  Paragraph  2 

"Preliminary  critical  item  tests  by  IBM  in  December  1984  showed  that  the 
bus'  software  system  processed  data  about  six  times  slower  than  the 
original  program  requirements." 

IBM  Conrent 

The  audit  report  is  accurate  that  this  milestone  was  not  achieved. 

However,  it  should  be  noted  that  a  workaround  plan  was  developed  in 
March  1985  showing  1)  an  interim  solution  to  protect  the  integration 
schedule  and  the  early  system  deliveries  and  2)  a  final  solution  to  meet 
full  system  requirements  and  support  original  ship  deployment  deliveries. 
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In  July  1985,  bus  performance  was  demonstrated  on  production  hardware 
showing  performance  more  than  adequate  to  support  the  ship  delivery 
system  in  May  1987.  Current  status  in  bus  development  shows  IBM 
accurately  tracking  the  plan  of  March  1985.  This  item  is  no  longer  a 
critical  path  for  system  delivery. 

Page  8,  Paragraph  5 

"Replan  III,  initiated  in  March  1985,  had  the  most  significant  Impact  on 
the  SubACS  design.  It  deleted  the  data  bus  entirely  from  the  program  and 
proposed  replacing  It  with  a  standard  computer-based  processing  system.” 

IBM  Comment 


Replan  III  was  initiated  within  the  Navy  In  March  via  a  briefing  to  CKO. 
IBM  started  planning  tasks  in  April  and  was  given  direction  to  implement 
Replan  III  via  contract  mod  on  May  6,  1985. 

Replan  III  did  not  delete  the  bus  in  its  entirety  as  stated.  The  fiber 
optics  data  bus  (array  bus)  was  deleted.  However,  an  equivalent  archi¬ 
tecture  wire  bus  Internal  to  the  beamformer  units  was  maintained  In  its 
original  configuration.  This  bus  uses  the  identical  software  and  has 
the  s.’tme  protocol  as  the  array  bus  deleted.  It  was,  therefore,  Important 
continue  the  original  bus  development  for  ship  deployment.  In  July  1985 
(after  the  GAO  audit  was  completed),  a  demonstration  of  the  wire  bus 
performance  was  successfully  completed  on  production  hardware  elements  of 
the  beamformer  unit. 

Page  9,  Paragraph  1 

"Further,  because  of  system  design  changes  and  reduced  performance  under 
Replan  III,  the  Navy  no  longer  plans  to  Install  SubACS  on  the  SSN-21 
attack  submarine  class  and  has  initiated  a  new  combat  system  development 
program  for  the  class." 
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See  GAO  comment  6 


Now  on  p.  8-9. 


See  GAO  comment  7 


6.  IBM  Connent 

The  statement  is  true  that  SubACS  Basic  is  not  planned  for  the  SSN-21. 

It  has  been  planned  from  the  inception  of  the  SSN-21  to  evolve  from  SubACS 
Basic  in  order  to  accoamodate  the  ship  improvements  of  the  SSN-21.  These 
include  the  new  large  spherical  array,  wide  aperture  array,  larger  horizontal 
weapon  tubes,  etc. 

The  new  FY-89  Combat  System  development  which  is  planned  for  the  SSN-21 
incorporates  the  needed  improvements  and  allows  use  of  modified  hardware 
and  software  from  SubACS  Basic.  This  evolution  includes  modifying  SubACS 
Basic  hardware  and  software  for  all  but  the  new  ship  sensors.  Candidate 
evolution  includes  retaining  or  modifying  the  Weapon  launch  Console,  SADS, 
MIDAS,  TBX,  Combat  System  Display  Console,  SUBRASS,  Multi-Purpose  Console, 
Ship  Data  Display/Data  Coverter,  etc.  The  only  currently  planned  new 
equipment  developments  are  the  new  sensor  interfaces  and  the  addition  of 
new  large  screen  displays.  These  are  the  same  developments  that  were 
planned  in  the  SubACS  evolution. 

7.  Page  10,  Paragraph  1 

"The  July  1  committee  report  concluded  that  neither  alternative  would 
meet  the  original  SubACS  performance  requirements  even  though  the  Navy 
has  made  several  changes  to  Replan  III.  Changes  included  freezing  the 
design  of  critical  equipment,  delaying  tests,  and  adding  an  essential 
capability  earlier  than  planned." 

IBM  Comment 

Changes  referred  to  here  really  fall  into  the  category  of  completing 
planning  rather  than  changing  Replan  III.  The  "essential  capability" 
refers  to  the  addition  of  the  PNB  capability  to  the  ship  delivery 
configuration.  Although  this  capability  could  not  be  completed  for 
Initial  delivery  In  May  1987,  all  of  the  supporting  hardware  is 
included  In  that  delivery.  The  associated  software  (only)  is  available 
for  installation  on  the  ship  in  September  1987,  at  the  option  of  the  Navy. 

At  the  time  of  the  committee  report,  planning  for  this  step  was  Incomplete. 
Since  that  time  detailed  planning  for  the  PNB  capability  has  been  completed 
and  supports  the  September  1987  delivery  option. 
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Now  on  p.  9. 


See  GAO  comment  8. 


Now  on  p.  9-10. 


See  GAO  comment  9 


IBM  Comment  (Continued) 


Also,  the  beamformer  design  (a  "critical  equipment")  was  being  assessed  in 
view  of  the  system  architecture  change.  The  design  has  since  been  baselined 
after  It  was  determined  to  meet  the  requirements  of  Replan  III. 

Page  10,  Paragraph  3 

"These  included  problems  with  developing,  integrating,  and  producing  system 
software,  particularly  for  one  critical  hardware  item,  a  common  beamformer." 

IBM  Comment 

This  unit  contains  a  wire  bus,  uses  the  identical  software  and  has  the  same 
protocol  as  the  array  bus  which  was  deleted  with  Replan  III.  In  July,  1985, 
(after  the  GAO  audit),  a  demonstration  of  the  wire  bus  performance  was 
successfully  completed  on  production  hardware  elements  of  the  beamformer  unit. 

The  schedule  for  delivering  a  common  beamformer  to  Test  and  Integration  was 
later  than  required;  all  risks  have  been  mitigated  by  reconfiguring  existing 
Replan  II  beamformer  units  into  the  Replan  III  configuration  as  Engineering 
Evaluation  Models  (EEM)  to  support  the  integration  schedule. 

(See,  also,  Coitment  #5) 


Page  11,  Paragraph  1 

•For  example,  software  for  the  SSN  751  combat  system  will  be  upgraded 
twice  --  once,  2-3  months  after  submarine  delivery  and  again,  9  months 
after  submarine  delivery.  With  respect  to  the  later  upgrade,  the  report 
also  stated  that  test  and  integration  planning  for  the  system’s  software 
was  Incomplete  ...." 

IBM  Cownent 

The  software  delivery  in  September,  1987,  is  not  an  upgrade  -  it  is  an 
initial  delivery  of  an  additional  function. 
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Now  on  p.  19. 


See  GAO  comment  10. 


Now  on  p.  21 


See  GAO  comment  1 1 . 


The  GAO  obtained  data  and  status  while  resident  at  IBM  from  December  1984 
through  May  1985.  The  formal  Replan  III  direction  was  received  on  May  6, 
1985.  The  planning  and  comnitted  schedules  had  not  been  completed  prior  to 
their  leaving  the  facility.  It  is  now  complete  and  supports  the  overall 
program  schedule  with  buffer  to  allow  for  contingency. 

10.  Appendix  III,  Page  10,  March  1985 

■Replan  III,  which  deleted  the  distributive  system  data  bus  from  the  program 
and  replaced  it  with  a  AN/UYK-7  (later  AN/UYK-43)  standard  computer-based 
processing  system,  was  developed. “ 

IBM  Conwent 


March,  1985  is  when  the  Replan  was  initiated  by  the  Navy  in  a  briefing  to 
CNO.  IBM  supported  the  Navy  In  planning  the  change  throughout  the  month 
of  April  and  was  given  contractual  direction  to  Implement  Replan  III  on 
May  6,  1985. 

11.  Appendix  IV,  Page  12,  Paragraph  3 

"The  Navy  has  indicated  that  without  this  model  it  is  not  possible,  to 
effectively  test  and  Integrate  the  SubACS  system  prior  to  delivery  to 
the  submarine.  The  second  SubACS  cownittee  considered  it  necessary  to 
have  a  full-time  model..." 

IBM  Conwent 


With  the  Inherent  parallelism  of  the  production  systems  it  was  clearly 
shown  that  an  Engineering  Model  is  not  required  for  the  development. 

The  second  committee  considered  a  seventh  test  bay  as  an  essential  element 
of  risk  reduction  to  provide  Integration  bay  time  buffer  for  schedule 
contingency.  This  bay  was  added  to  the  plan  using  contractor  Capital 
Funds  and,  again,  populated  with  available  production  assets.  Little  risks 
exists  in  the  Program  Plan  today  due  to  the  lack  of  development  facilities. 
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Now  on  p.  21. 


See  GAO  comment  12 


Now  on  p.  22. 


See  GAO  comment  13 


Now  on  p.  5. 


11.  IBM  Coment  (Continued) 

While  an  Engineering  Development  Model  Mould  be  a  more  optimum  approach  for 
development,  it  is  not  essential  and  Mould  add  additional  cost  to  the  program. 
The  above  approach  using  production  assets  meets  program  needs. 

12.  Appendix  IV,  Page  13,  Paragraph  2 

"In  addition,  the  average  cost  of  a  ceramic  module  has  almost  doubled." 

IBM  Cowmen t 


Ceramic  Module  costs  have  groMn  by  35S,  not  1001  as  stated.  The  groMth 
is  attributed  to  lomer  quantities  of  modules  resulting  from  Replan  III 
Baseline  changes  and  early  producibility  problems.  (The  produdbility 
Issues  have  all  since  been  resolved.) 

In  addition,  one  non-ceramic  module’s  recurring  cost  did  Increase  signifi¬ 
cantly.  The  technical  problems  Mhlch  drove  the  cost  Increase  are  hom  under 
control . 

13.  Appendix  IV,  Page  14,  Paragraph  1 

"On  March  26,  1985,  IBM  advised  the  SubACS  Project  Office  that  it  had 
underestimated  softuare  schedule  deliveries  by  15  percent.  As  a  result, 

IBM  estimated  that  test  and  Integration  for  six  softMare  schedule  deliveries 
mould  be  delayed  from  2  months  to  more  than  2  years." 

IBM  Comncnt 


The  schedule  Issues  referenced  Mere  associated  Mlth  Test  I  Integration.  The 
"underestimate"  mas  the  time  allocated  to  Integration  and  sell  off  of  a  full- 
up  system.  As  a  result,  the  capability  at  system  delivery  mss  broken  Into 
tMO  segments,  May  1987  and  September  1988.  When  the  softMare  functions  Mere 
re-mapped,  some  functions  moved  In  the  schedule.  Those  functions  associated 
Mlth  post  1988  moved  "more  than  tMO  years".  (These  functions  comprise  2.3X 
of  the  total  softMare.) 

Also,  see  comnent,  same  point,  on  Page  6,  Paragraph  1. 
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Now  on  p.  22. 


See  GAO  comment  14. 


Now  on  p.  22. 


See  GAO  comment  15 


14.  Appendix  IV,  Page  14,  Paragraph  3 

"In  addition,  units  that  interfaced  with  the  bus  had  to  be  redesigned  due 
to  ceramic  module  problems." 

IBM  Comment 

This  statement  cannot  be  supported.  Ceramic  module  performance  has  not 
been  an  Issue.  Over  the  six  month  period  of  the  audit,  ceramic  module 
production  was  the  Issue.  This  has  since  been  resolved  with  no  Impact 
to  the  end  deliveries. 


15.  Appendix  IV,  Page  14.  Paragraph  4 

"The  original  system  was  too  complex,  and  the  data  bus  was  eventually  taken 
out  of  SubACS  primarily  because  of  performance  and  funding  considerations." 

IBM  Comncnt 

As  stated  in  an  earlier  comment,  the  entire  bus  was  not  deleted.  Although 
performance  was  an  early  factor,  IBM  was  projecting  recovery  through  a  two 
phased  (Interim/final)  plan  of  Improvements.  Present  status  shows  all 
problems  corrected  and  proceeding  on  plan. 

The  ultimate  decision  to  eliminate  the  fiber  optic  array  bus  was  more  out 
of  a  concern  for  the  risk  to  the  Integration  schedule  and  how  long  it  would 
take  to  Integrate  the  "distributed  system"  and  recurring  cost  of  future 
systems  beyond  SubACS  Basic.  Front-end  schedule  delays  were  already  Impacting 
the  planned  start  of  system  Integration. 
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Now  on  p.  24-25. 


See  GAO  comment  16 


Now  on  p.  25. 


See  GAO  comment  17 


16.  Appendix  V,  Page  17,  Paragraph  3 

"Several  changes  to  Replan  III  were  made  after  the  first  comnittee  completed 
Its  review.  These  changes  included  freezing  design  of  a  critical  piece  of 
equipment,  thereby  reducing  software  development;  increasing  the  time 
available  for  test  and  integration  by  adding  additional  test  facilities, 
delaying  system  design  certification  testing  until  September,  1988  and 
reducing  crew  training;" 

IBB  Comnent 

The  report  failed  to  represent  the  Program  Plan  as  briefed  to  the  Second  Navy 
SubACS  Comnittee  and  subsequently  implemented.  The  Plan  shows  that  system 
certification  is  accomplished  on  each  delivered  system  configuration  prior 
to  delivery  with  final  System  Design  Certification  completed  in  September, 
1988.  The  integration  plans  and  schedules  clearly  show  a  full  System  Design 
Certification  (SDCT)  of  the  Combat  Control  system  in  4th  quarter  of  1986  and 
acoustic  certification  of  PBB  &  PNB  (total  functions  delivered)  prior  to 
delivery  and  well  ahead  of  the  November  1987  ship  delivery  date. 

17.  Appendix  V,  Page  18.  Sentence  <3 

" —  Neither  approach  meets  the  top  level  requirements  of  the  original 
SubACS  program;  therefore,  top  level  requirements  need  to  be  revised 
to  reflect  reduced  capabilities." 

IBM  Comment 

The  Prime  Item  Development  Specification  (PIDS)  represents  the  Navy's 
implementation  of  the  top  level  requirements  and  in  the  governing  require¬ 
ments  document  between  the  Navy  and  IBM.  The  PIDS  have  been  modified  to 
accomodate  the  system  architecture  change  and  use  of  AN/BQQ-5D  software 
associated  with  Replan  III.  In  our  judgement,  these  modifications  to  the 
original  PIDS  are  minimal  (i.e.,  changes  are  primarily  in  the  area  of  oper¬ 
ability)  and  do  not  Impact  mission  performance.  It  is  our  understanding 
that  the  top  level  requirements  were  minimally  modified  by  the  Navy  to 
accomodate  the  Replan  III  PIDS. 
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Now  on  p.  25 


See  GAO  comment  18 


18.  Appendix  V.  Page  18..  last  sentence 


--  delay  of  system  design  certification  testing  until  after  delivery 
of  the  first  SubACS  submarine. 

IBM  Comment 

This  point  does  not  accurately  reflect  the  Program  Plan  as  briefed 
to  the  Second  Navy  SubACS  Committee.  The  plan  provided  details  of 
Incremental  functional  deliveries  in  May  1987  and  September  1987  with 
full  system  capability  delivered  in  September  1988.  Each  incremental 
delivery  is  certified  to  the  maximum  extent  the  system  configuration 
allows. 


(See  Comnent  16) 
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The  following  is  our  evaluation  of  IBM  Corporation’s  letter,  dated 
October  24,  1985. 


GAO  Comments 


1.  No  revision  to  our  report  is  required.  IBM  agrees  with  the  $3.8  million 
growth  and  provides  other  data  reflecting  on  the  Navy’s  management  of 
the  subacs  program. 

2.  No  revision  to  our  report  is  required.  Comment  reflects  IBM’s  views  on 
the  Navy’s  management  of  the  subacs  program. 

3.  No  revision  to  our  report  is  required.  IBM’s  comment  essentially  pro¬ 
vides  detailed  technical  reasons  for  delays  in  software  deliveries. 

4.  No  revision  to  our  report  is  required,  ibm  agrees  the  December  1984 
tests  showed  that  the  software  system  for  the  data  bus  operated  at  one- 
sixth  the  speed  originally  planned.  Our  report  addresses  technical  per¬ 
formance  problems  encountered  during  development  of  the  original 
subacs  configuration,  which  included  a  distributed  system  data  bus. 

This  data  bus,  a  major  technological  innovation  for  subacs,  was  to  inte¬ 
grate  acoustic  and  combat  control  subsystems  into  one  major  combat 
system  using  fiber  optics  to  distribute  and  communicate  data.  Under 
Replan  III,  the  data  bus  was  removed  from  the  configuration  and 
changes  were  made  in  the  performance  parameters  for  subacs. 

IBM  provides  additional  information  on  program  replanning  efforts,  par¬ 
tially  taken  in  response  to  the  data  bus  development  problems.  How¬ 
ever,  the  bus  discussed  later  in  IBM’s  comment  is  a  wire  bus,  retained  in 
the  subacs  beamformer  units  from  the  original  subacs  configuration, 
and  not  the  data  bus  referred  to  in  our  report.  IBM  provides  the  develop 
ment  status  of  the  wire  bus  under  Replan  III. 

5.  No  revision  to  our  report  is  required.  Data  bus,  as  used  in  our  report, 
refers  only  to  the  fiber  optics  bus  and  not  to  the  wire  bus  internal  to  the 
subacs  beamformer  units  (retained  in  the  Replan  III  configuration  from 
the  original  subacs  configuration),  ibm  provides  additional  information 
on  program  replanning  efforts  and  makes  a  distinction  between  the  wire 
bus  and  the  data  bus  developments  in  the  subacs  (Replan  III) 
configuration. 

6.  No  revision  to  our  report  is  required.  Since  our  draft  report  was  sent 
to  ibm  for  comment,  we  have  revised  our  report  to  reflect  the  Navy’s 
separation  of  the  subacs  effort  into  two  programs — subacs  (Replan  III) 
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and  FY  89  Combat  System.  Details  of  the  proposed  FY  89  Combat  Sys¬ 
tem  plan  and  design  are  still  being  defined  by  the  Navy.  IBM’s  comment 
provides  additional  information  on  the  proposed  plan  to  evolve  portions 
of  the  FY  89  Combat  System  design  from  modified  subacs  (Replan  III) 
hardware  and  software. 

7.  No  revision  to  our  report  is  required.  At  the  time  of  the  first  subacs 
committee’s  review,  neither  Replan  III  nor  “BQQ-5  Like”  had  been  com¬ 
pletely  defined.  However,  at  the  time  of  the  second  subacs  committee, 
several  changes  to  Replan  III,  as  noted  in  our  report,  had  been  made  by 
the  Navy  and  IBM  as  more  detailed  plans  were  completed  for  the  pro¬ 
posed  alternative.  After  completion  of  the  second  committee’s  report, 
further  refinements  were  made  to  Replan  III.  IBM’s  comment  provides 
additional  information  on  the  completion  of  planning  for  Replan  III. 

8.  No  revision  to  our  report  is  required.  IBM’s  comment  provides  addi¬ 
tional  information  on  testing  conducted  for  the  beamformer’s  wire  bus 
after  our  IBM  audit  work  was  completed.  Also,  see  our  response  to  IBM’s 
comment  #5. 

9.  No  revision  to  our  report  is  required.  IBM’s  comment  reflects  an  initial 
delivery  of  an  additional  function  in  September  1987  (not  discussed  in 
our  report).  Although  this  function  will  be  delivered  before  shipbuilder’s 
delivery  of  the  SSN  751  (November  1987),  upgrades  will  be  required,  as 
noted  in  our  report,  to  provide  the  system  with  improved  capabilities. 
These  upgrades  are  scheduled  for  delivery  in  about  January  1988  and 
September  1988. 

10.  No  revision  to  our  report  is  required.  IBM's  comment  provides  addi¬ 
tional  information  on  the  implementation  of  Replan  III. 

1 1.  No  revision  to  our  report  is  required.  Although  IBM  states  that  an 
Engineering  Development  Model  would  be  a  more  optimum  approach  for 
development,  it  disagrees  with  the  second  subacs  committee  that  a  full¬ 
time  model  was  necessary  to  effectively  test  and  integrate  the  system 
prior  to  delivery  to  the  submarine.  IBM  provides  its  views  on  the  ade¬ 
quacy  of  using  available  production  assets  in  meeting  program  develop¬ 
ment  needs. 

12.  We  have  revised  our  report  to  show7  that  according  to  EG&G,  the 
Navy’s  support  contractor,  the  average  cost  (including  all  nonrecurring 
costs)  for  al]  ceramic  modules,  produced  by  all  vendors,  has  almost 
doubled. 
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13.  IBM’s  comment  provides  further  details  on  those  software  deliveries 
delayed  more  than  2  years.  We  changed  our  report  to  note  that  those 
functions  delayed  more  than  2  years  comprise  2.3  percent  of  the  total 
software. 

14.  To  more  accurately  reflect  the  reasons  for  redesign  of  the  units,  our 
report  has  been  revised  as  follows: 

“In  addition,  units  that  interfaced  with  the  data  bus  had  to  be  redesigned 
due  to  ceramic  module  delivery  delays.  The  delays  were  due  to  vendor  diffi¬ 
culties  in  meeting  Navy  testing  requirements  and  low  production  yields.” 

15.  No  revision  to  our  report  is  required.  IBM’s  comment  provides  addi¬ 
tional  information  on  the  subacs  replanning  efforts,  particularly  the  rea¬ 
son  for  deleting  the  distributed  system  data  bus  from  the  original  subacs 
configuration.  Also,  see  our  responses  to  IBM’s  comments  #4  and  #5. 

16.  IBM’s  comment  indicates  that  system  design  certification  testing  for 
the  first  system  will  occur  in  the  fourth  quarter  of  1986  and  prior  to 
delivery.  (We  believe  IBM  is  referring  to  the  May  1987  system  delivery  to 
the  shipbuilder  )  However,  IBM  acknowledges  that  final  system  design 
certification  testing  will  not  be  completed  until  September  1988.  We 
have  revised  our  report  to  indicate  that  the  September  1988  date  is  the 
completion  of  final  system  design  certification  testing. 

17.  No  revision  to  our  report  is  required.  IBM’s  comments  reflect  its 
views  and  understanding  of  the  planned  revisions  to  the  subacs  top- 
level  requirements. 

18.  As  indicated  earlier  by  IBM  (comment  #16),  final  system  design  certi¬ 
fication  testing  will  not  be  completed  until  September  1988.  Our  report 
refers  to  one  of  several  possible  risks,  as  indicated  to  us  by  the  chairper¬ 
son  of  the  second  subacs  committee,  in  implementing  Replan  III.  The 
chairperson  believed  system  design  certification  testing  was  a  high  risk 
in  Replan  III  and  completion  of  this  testing  could  be  delayed  until  after 
delivery  of  the  first  suBACS-equipped  submarine,  SSN  751.  We  have 
revised  our  report  to  indicate  that  the  risk  is  in  completing  certification 
testing  for  the  system  prior  to  the  SSN  751  submarine  delivery. 


(394030) 
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Requests  for  copies  of  GAO  reports  should  be  sent  to: 

U.S.  General  Accounting  Office 
Post  Office  Box  6015 
Gaithersburg,  Maryland  20877 

Telephone  202-275-6241 

The  first  five  copies  of  each  report  are  free.  Additional  copies  are 
$2.00  each. 

There  is  a  25%  discount  on  orders  for  100  or  more  copies  mailed  to  a 
single  address. 

Orders  must  be  prepaid  by  cash  or  by  check  or  money  order  made  out  to 
the  Superintendent  of  Documents. 
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